00000001:02000400:2.0F:1788839076.959976:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788839095.483738:0:3189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788839096.696428:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 515 MB/s 00000001:01000000:2.0:1788839096.949176:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1027 MB/s 00000001:01000000:1.0F:1788839097.202771:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4984 MB/s 00000020:02000000:1.0:1788839098.186947:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_115_g0321d60 00000400:02000000:1.0:1788839099.481486:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.109@tcp [8/256/0/180] 00008000:02000000:0.0:1788839103.960299:0:3445:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788839162.563864:0:5247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788839173.404028:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788839173.404035:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788839173.404535:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004886a743 00000080:02000400:1.0:1788839173.404547:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788839173.412031:0:5824:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788839173.412047:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788839173.412180:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000055782f84) 00000020:00000080:1.0:1788839173.412202:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788839173.433799:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788839173.434277:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788839173.463228:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788839173.463285:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788839173.463302:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788839173.463342:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788839173.463360:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788839173.463652:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788839173.463659:0:5824:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788839173.463667:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d6363f94b 00000020:01000004:2.0:1788839173.463673:0:5824:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788839173.463676:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788839173.463680:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004886a743 from MGS 00000020:01000004:2.0:1788839173.463684:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788839173.463698:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000018f751f2) 00000020:00000080:2.0:1788839173.463707:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788839173.463787:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004886a743 from MGS, refs=2 00080000:01000000:2.0:1788839173.463790:0:5824:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788839173.463793:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d6363f959 00000100:00100000:2.0:1788839173.463858:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788839173.463976:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788839173.463989:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788839173.470583:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788839173.470596:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788839173.471206:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839173.471394:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788839173.471397:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788839173.472905:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788839173.472915:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788839173.473388:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788839173.473393:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788839173.473860:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839173.473866:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839173.473868:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1788839173.476735:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839173.476747:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839173.476749:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839173.477667:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788839173.481600:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788839173.727587:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3463 MB/s 00000001:01000000:3.0:1788839173.977322:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3523 MB/s 00000001:01000000:2.0:1788839174.227915:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 487 MB/s 00000001:01000000:3.0:1788839174.478497:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 756 MB/s 00080000:10000000:2.0:1788839174.493214:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788839174.525898:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788839174.525915:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788839174.525918:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1788839174.526408:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788839174.529295:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788839174.529380:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788839174.529447:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788839174.529688:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788839174.529716:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788839174.530119:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839174.530325:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788839174.530331:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788839174.532582:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788839174.532602:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788839174.533395:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788839174.533403:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788839174.537890:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788839174.537916:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.109@tcp' 00000020:01000004:1.0:1788839174.537918:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788839174.539301:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.109@tcp (typ=mgc) 00000020:00000080:1.0:1788839174.539316:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.109@tcp (000000001e1602cb) 00000020:00000080:1.0:1788839174.539334:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788839174.539420:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b23c7aab@MGC192.168.201.109@tcp: add connection 192.168.201.109@tcp at head 00010000:00010000:1.0:1788839174.539632:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.109@tcp-0 is initialized 00000040:01000000:1.0:1788839174.539639:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788839174.540295:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788839174.549609:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788839174.549731:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.109@tcp (uuid 2841848a-c637-485f-b8f2-edd7dddc336d) 00000020:00000080:0.0:1788839174.549762:0:5824:0:(genops.c:1385:class_connect()) connect: client 2841848a-c637-485f-b8f2-edd7dddc336d, cookie 0x4b63896d6363f967 00000100:00080000:0.0:1788839174.549776:0:5824:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788839174.549781:0:5824:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import 00000000b23c7aab using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839174.549900:0:5824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000831f57a2 x1875733747073152/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839174.549929:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2841848a-c637-485f-b8f2-edd7dddc336d->MGS 00000020:01000004:0.0:1788839174.549952:0:5824:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788839174.549957:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788839174.549993:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004781bf42) 00000020:00000080:0.0:1788839174.550009:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788839174.550964:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000831f57a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2841848a-c637-485f-b8f2-edd7dddc336d:3310:1875733747073152:0@lo:250: 00000100:00100000:2.0:1788839174.551308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839174.551406:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747073152 00000100:00100000:2.0:1788839174.551414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747073152 00000100:00100000:2.0:1788839174.551444:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839174.551450:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb012cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875733747073152:12345-0@lo:250: 00010000:00080000:2.0:1788839174.551487:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2841848a-c637-485f-b8f2-edd7dddc336d@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1788839174.551515:0:5836:0:(genops.c:1385:class_connect()) connect: client 2841848a-c637-485f-b8f2-edd7dddc336d, cookie 0x4b63896d6363f975 00000100:00080000:2.0:1788839174.551655:0:5836:0:(import.c:65:import_set_state_nolock()) 000000008d33cb29 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839174.551706:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb012cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+5:3310:x1875733747073152:12345-0@lo:250: Request processed in 256us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839174.551712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839174.551745:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788839174.551752:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.109@tcp: connect to target with instance 0 00000100:00080000:2.0:1788839174.551758:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788839174.551765:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788839174.551767:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000b23c7aab MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788839174.551769:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788839174.551774:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788839174.551777:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000831f57a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2841848a-c637-485f-b8f2-edd7dddc336d:3310:1875733747073152:0@lo:250: 00000100:00100000:0.0:1788839174.566423:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839174.566655:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788839174.566662:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788839174.568275:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788839174.568355:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788839174.568714:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788839174.568720:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788839174.569663:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839174.569913:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788839174.569918:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788839174.570486:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788839174.570493:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788839174.615895:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839174.616925:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788839174.616933:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788839174.618320:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788839174.618333:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788839174.618970:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839174.619263:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788839174.619269:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788839174.620463:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788839174.620475:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788839174.621264:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839174.621456:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788839174.621460:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788839174.621914:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788839174.621926:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788839174.623493:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839174.623743:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788839174.623749:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788839174.624501:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788839174.624509:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788839174.670633:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839174.670990:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788839174.670996:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788839174.672872:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788839174.672891:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788839174.678411:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788839174.678431:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788839174.683331:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788839174.683697:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788839174.683704:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788839174.683920:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788839174.683955:0:5824:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788839174.683960:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788839174.683961:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788839174.683963:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839174.683964:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839174.683965:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839174.683966:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839174.683967:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839174.683969:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788839174.683970:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788839174.683971:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788839174.683972:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839174.683974:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788839174.683976:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788839174.683979:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788839174.683980:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788839174.683981:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839174.683982:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839174.683983:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839174.683985:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839174.683986:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839174.683987:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788839174.683988:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788839174.683989:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788839174.683990:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839174.683991:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788839174.684020:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788839174.684039:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b031e96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073280:0@lo:253: 00000100:00100000:2.0:1788839174.684490:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839174.684585:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b4ec9ff going to sleep for 11 seconds 00000100:00100000:3.0:1788839174.684668:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747073280 00000100:00100000:3.0:1788839174.684676:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747073280 00000100:00100000:3.0:1788839174.684771:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839174.684780:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce0d0c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+5:5824:x1875733747073280:12345-0@lo:253: 20000000:01000000:3.0:1788839174.684833:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788839174.684836:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788839174.685392:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788839174.685458:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788839174.685722:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839174.689699:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788839174.693105:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788839174.693113:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788839174.693119:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788839174.693122:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788839174.693139:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788839174.693678:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839174.693917:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788839174.693931:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788839174.693976:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788839174.694023:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788839174.694091:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788839174.694192:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788839174.694203:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788839174.694259:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788839174.694268:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788839174.694299:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788839174.694307:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788839174.694350:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788839174.694415:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788839174.694446:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788839174.694450:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788839174.694462:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839174.695382:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788839174.695402:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788839174.695453:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788839174.695488:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788839174.695533:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788839174.695547:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788839174.695632:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788839174.695641:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788839174.695680:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788839174.695713:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788839174.695744:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788839174.695755:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788839174.695831:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788839174.695839:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788839174.695870:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788839174.695902:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788839174.696085:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788839174.696131:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788839174.696139:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788839174.698170:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788839174.698626:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788839174.698668:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.109@tcp for mdt 20000000:01000000:1.0:1788839174.698676:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:1.0:1788839174.698722:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788839174.698730:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788839174.698775:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788839174.698783:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:1.0:1788839174.699181:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788839174.699193:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788839174.699244:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788839174.699299:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788839174.699402:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788839174.699405:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788839174.699417:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788839174.699424:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788839174.700724:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788839174.701523:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788839174.712269:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788839174.712361:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788839174.712440:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788839174.712458:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788839174.712461:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788839174.712465:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788839174.712478:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788839174.712481:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788839174.712509:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788839174.712512:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788839174.713406:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788839174.714638:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788839174.714697:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788839174.714768:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1788839174.714782:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788839174.714784:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788839174.715493:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788839174.715683:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788839174.715724:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788839174.715772:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788839174.715804:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839174.715824:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788839174.715833:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788839174.715860:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715876:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715891:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715898:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715904:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715910:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715915:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093f1dadc already unused, calling callback (000000009f01d2e6) 00010000:00010000:2.0:1788839174.715924:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715933:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715944:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715951:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.715998:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000093f1dadc/0x4b63896d6363f97c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788839174.716013:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788839174.984509:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce0d0c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+5:5824:x1875733747073280:12345-0@lo:253: Request processed in 299723us (300013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839174.984530:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839174.984672:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b031e96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073280:0@lo:253: 10000000:01000000:2.0:1788839174.984690:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788839174.984694:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839174.984696:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839174.984697:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839174.984698:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788839174.984699:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839174.984701:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839174.984702:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839174.984704:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839174.984705:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788839174.984707:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839174.984708:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788839174.984729:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004886a743 from lustre-MDT0000 10000000:01000000:2.0:1788839174.984757:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788839174.984759:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788839174.984764:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91eb09e08000 10000000:01000000:2.0:1788839174.984768:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839174.984775:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eb09e08000 from 1 10000000:01000000:2.0:1788839174.984778:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788839174.984962:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 0000000093f1dadc/0x4b63896d6363f983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.984973:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 0000000093f1dadc/0x4b63896d6363f983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.984982:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 0000000093f1dadc/0x4b63896d6363f983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839174.985012:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de716eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073408:0@lo:101: 00000100:00100000:2.0:1788839174.985074:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839174.985222:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319de79f going to sleep for 11 seconds 00000100:00100000:3.0:1788839174.985299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747073408 00000100:00100000:3.0:1788839174.985305:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747073408 00000100:00100000:3.0:1788839174.985347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839174.985461:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd489956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+5:5824:x1875733747073408:12345-0@lo:101: 00010000:00010000:3.0:1788839174.985476:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839174.985492:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f0e4535/0x4b63896d6363f98a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363f983 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.985515:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f0e4535/0x4b63896d6363f98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363f983 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.985524:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f0e4535/0x4b63896d6363f98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363f983 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.985532:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f0e4535, rc 0) 00000100:00100000:3.0:1788839174.985678:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd489956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+6:5824:x1875733747073408:12345-0@lo:101: Request processed in 324us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839174.985684:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839174.985758:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de716eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073408:0@lo:101: 00010000:00010000:2.0:1788839174.985770:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 0000000093f1dadc/0x4b63896d6363f983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.985778:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 0000000093f1dadc/0x4b63896d6363f983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839174.985942:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de716eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073536:0@lo:501: 00000100:00100000:2.0:1788839174.985970:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839174.986030:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319de79f going to sleep for 11 seconds 00000100:00100000:1.0:1788839174.986144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747073536 00000100:00100000:1.0:1788839174.986149:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747073536 00000100:00100000:0.0:1788839174.986301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839174.986308:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d76f5c32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+6:5824:x1875733747073536:12345-0@lo:501: 00000100:00100000:0.0:1788839174.986776:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d76f5c32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+6:5824:x1875733747073536:12345-0@lo:501: Request processed in 468us (805us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839174.986785:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839174.986982:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de716eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073536:0@lo:501: 10000000:01000000:3.0:1788839174.987010:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788839174.987029:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 0000000093f1dadc/0x4b63896d6363f983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.987040:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 0000000093f1dadc/0x4b63896d6363f983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839174.987069:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eb02d49000 10000000:01000000:3.0:1788839174.987074:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788839174.987079:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91eb02d49000 10000000:01000000:3.0:1788839174.987088:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788839174.987091:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91eb02d49000 from 1 10000000:01000000:3.0:1788839174.987094:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788839174.987129:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000f5dc57ce/0x4b63896d6363f991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.987137:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000f5dc57ce/0x4b63896d6363f991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.987145:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000f5dc57ce/0x4b63896d6363f991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839174.987159:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073664:0@lo:101: 00000100:00100000:3.0:1788839174.987192:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839174.987310:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072b61384 going to sleep for 11 seconds 00000100:00100000:0.0:1788839174.987433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747073664 00000100:00100000:0.0:1788839174.987438:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747073664 00000100:00100000:0.0:1788839174.987497:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839174.987505:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000952a26e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+6:5824:x1875733747073664:12345-0@lo:101: 00010000:00010000:0.0:1788839174.987515:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839174.987527:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000326f89a0/0x4b63896d6363f998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363f991 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839174.987546:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000326f89a0/0x4b63896d6363f998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363f991 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839174.987554:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000326f89a0/0x4b63896d6363f998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363f991 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839174.987562:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000326f89a0, rc 0) 00000100:00100000:0.0:1788839174.987604:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000952a26e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+7:5824:x1875733747073664:12345-0@lo:101: Request processed in 100us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839174.987609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839174.987665:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073664:0@lo:101: 00010000:00010000:3.0:1788839174.987675:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000f5dc57ce/0x4b63896d6363f991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.987682:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000f5dc57ce/0x4b63896d6363f991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839174.987693:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788839174.987701:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000f5dc57ce/0x4b63896d6363f991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.987707:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000f5dc57ce/0x4b63896d6363f991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839174.987713:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788839174.987722:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839174.987726:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91eb02d49000 10000000:01000000:3.0:1788839174.987729:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788839174.987732:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788839174.987734:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788839174.987746:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000b41b9785/0x4b63896d6363f99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.987752:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000b41b9785/0x4b63896d6363f99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.987758:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000b41b9785/0x4b63896d6363f99f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839174.987768:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073792:0@lo:101: 00000100:00100000:3.0:1788839174.987790:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839174.988063:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072b61384 going to sleep for 11 seconds 00000100:00100000:2.0:1788839174.988197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747073792 00000100:00100000:2.0:1788839174.988203:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747073792 00000100:00100000:2.0:1788839174.988238:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839174.988243:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022631145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+7:5824:x1875733747073792:12345-0@lo:101: 00010000:00010000:2.0:1788839174.988251:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839174.988260:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e2d0bfb6/0x4b63896d6363f9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363f99f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.988275:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2d0bfb6/0x4b63896d6363f9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363f99f expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.988283:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e2d0bfb6/0x4b63896d6363f9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363f99f expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839174.988301:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e2d0bfb6, rc 0) 00000100:00100000:2.0:1788839174.988338:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022631145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+8:5824:x1875733747073792:12345-0@lo:101: Request processed in 96us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839174.988345:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839174.988447:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073792:0@lo:101: 00010000:00010000:3.0:1788839174.988457:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000b41b9785/0x4b63896d6363f99f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839174.988463:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000b41b9785/0x4b63896d6363f99f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839174.988505:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073920:0@lo:501: 00000100:00100000:3.0:1788839174.988527:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839174.988544:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072b61384 going to sleep for 11 seconds 00000100:00100000:2.0:1788839174.988589:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747073920 00000100:00100000:2.0:1788839174.988593:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747073920 00000100:00100000:2.0:1788839174.988606:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839174.988610:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000230ac8bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+8:5824:x1875733747073920:12345-0@lo:501: 00000100:00100000:2.0:1788839174.988970:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000230ac8bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:5824:x1875733747073920:12345-0@lo:501: Request processed in 358us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839174.988976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839174.989135:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747073920:0@lo:501: 00000100:00100000:3.0:1788839174.989161:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074048:0@lo:503: 00000100:00100000:3.0:1788839174.989203:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839174.989244:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072b61384 going to sleep for 11 seconds 00000100:00100000:2.0:1788839174.989292:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074048 00000100:00100000:2.0:1788839174.989296:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074048 00000100:00100000:2.0:1788839174.989312:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839174.989316:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056f3dbcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:5824:x1875733747074048:12345-0@lo:503: 00000100:00100000:2.0:1788839174.989511:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056f3dbcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:5824:x1875733747074048:12345-0@lo:503: Request processed in 195us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839174.989518:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839174.989592:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074048:0@lo:503: 00000100:00100000:3.0:1788839174.989990:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5865:1875733747074176:0@lo:502: 00000100:00100000:3.0:1788839174.990024:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839174.990044:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074176 00000100:00100000:3.0:1788839174.990047:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074176 00000100:00100000:3.0:1788839174.990081:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839174.990087:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f56c51a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:5865:x1875733747074176:12345-0@lo:502: 00000100:00100000:3.0:1788839174.990232:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f56c51a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:5865:x1875733747074176:12345-0@lo:502: Request processed in 145us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839174.990238:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839174.990267:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000004df90a65 going to sleep for 11 seconds 00000100:00100000:3.0:1788839174.990278:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5865:1875733747074176:0@lo:502: 00000020:01000000:3.0:1788839174.990297:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839174.990308:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839174.990310:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788839174.990315:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788839174.990318:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839174.990338:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007cb0cd44) 00000020:00000080:3.0:1788839174.990368:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788839174.990376:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788839174.990453:0:5865:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788839174.990461:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d6363f9b4 00000020:00000080:3.0:1788839174.990703:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788839174.990708:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839174.990712:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839174.990713:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788839174.990722:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839174.990726:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839174.990728:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788839174.990731:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839174.990738:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a103a9dc) 00000020:00000080:3.0:1788839174.990747:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788839174.990751:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788839174.990753:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788839174.990756:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788839174.990762:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788839174.990810:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004886a743 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788839174.990821:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005b1f33ce) 00000020:00000080:3.0:1788839174.991002:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788839174.991080:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788839174.991086:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d6363f9c9 00000020:00000080:3.0:1788839174.991197:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788839174.991203:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788839174.991208:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b63896d6363f9d0 00080000:01000000:3.0:1788839174.991225:0:5865:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788839174.991228:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d6363f9d7 00080000:10000000:3.0:1788839174.992014:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788839174.992455:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788839174.997279:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788839175.076785:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788839175.077510:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788839175.082035:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788839175.083504:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788839175.117736:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ad94a4a3) 00000020:00000080:2.0:1788839175.117761:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788839175.117974:0:5865:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788839175.117982:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d6363f9e5 00000020:00000080:3.0:1788839175.118717:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788839175.121278:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788839175.172679:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788839175.201520:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788839175.238441:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788839175.300453:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788839175.323657:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788839175.367243:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b63896d6363f9ec 00000020:00000080:0.0:1788839175.367574:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788839175.367588:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839175.367594:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839175.367597:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788839175.367600:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839175.367606:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839175.367607:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788839175.367611:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788839175.367645:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788839175.367661:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839175.367664:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839175.367665:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788839175.367667:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839175.367670:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839175.367671:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788839175.367674:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788839175.367675:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788839175.367723:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9387c84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5865:1875733747074304:0@lo:502: 00000100:00100000:0.0:1788839175.367812:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839175.367912:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032423d5a going to sleep for 11 seconds 00000100:00100000:3.0:1788839175.368264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074304 00000100:00100000:3.0:1788839175.368273:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074304 00000100:00100000:3.0:1788839175.368357:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839175.368367:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024ede7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:5865:x1875733747074304:12345-0@lo:502: 00000100:00100000:3.0:1788839175.368894:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024ede7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:5865:x1875733747074304:12345-0@lo:502: Request processed in 528us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839175.368903:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839175.369027:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9387c84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5865:1875733747074304:0@lo:502: 00000020:01000000:0.0:1788839175.369122:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839175.369130:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839175.369132:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788839175.369135:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788839175.369335:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788839175.369353:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788839175.369416:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000b41b9785/0x4b63896d6363f99f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.369426:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000b41b9785/0x4b63896d6363f99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839175.369434:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eb02d49000 from 1 10000000:01000000:3.0:1788839175.369437:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839175.369465:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.369472:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.369480:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839175.369494:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074432:0@lo:101: 00000100:00100000:3.0:1788839175.369533:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.369573:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000222194d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788839175.369628:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074432 00000100:00100000:0.0:1788839175.369634:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074432 00000100:00100000:0.0:1788839175.369668:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839175.369685:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090de12a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+9:5824:x1875733747074432:12345-0@lo:101: 00010000:00010000:0.0:1788839175.369696:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839175.369708:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363f9f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839175.369729:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839175.369750:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839175.369760:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060dc0a23, rc 0) 00000100:00100000:0.0:1788839175.369805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090de12a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+10:5824:x1875733747074432:12345-0@lo:101: Request processed in 121us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839175.369811:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839175.370017:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074432:0@lo:101: 00010000:00010000:3.0:1788839175.370031:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.370075:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839175.370616:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074560:0@lo:256: 00000100:00100000:3.0:1788839175.370663:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.370685:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000222194d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788839175.370932:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074560 00000100:00100000:0.0:1788839175.370938:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074560 00000100:00100000:0.0:1788839175.371014:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839175.371023:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d496d6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+10:5824:x1875733747074560:12345-0@lo:256: 20000000:01000000:0.0:1788839175.371041:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788839175.371047:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788839175.371139:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d496d6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+10:5824:x1875733747074560:12345-0@lo:256: Request processed in 117us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839175.371147:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839175.371417:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074560:0@lo:256: 10000000:01000000:3.0:1788839175.372121:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839175.372198:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.372238:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839175.372246:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02d49000 from 1 10000000:01000000:3.0:1788839175.372249:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839175.372280:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.372287:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.372296:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839175.372310:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074688:0@lo:101: 00000100:00100000:3.0:1788839175.372353:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.372403:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000222194d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788839175.372480:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074688 00000100:00100000:1.0:1788839175.372487:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074688 00000100:00100000:1.0:1788839175.372526:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839175.372534:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000607221d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+10:5824:x1875733747074688:12345-0@lo:101: 00010000:00010000:1.0:1788839175.372544:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839175.372557:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fa01 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.372588:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.372597:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.372605:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d38d67e, rc 0) 00000100:00100000:1.0:1788839175.372638:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000607221d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:5824:x1875733747074688:12345-0@lo:101: Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839175.372644:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839175.372732:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074688:0@lo:101: 00010000:00010000:3.0:1788839175.372755:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.372763:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839175.372821:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074816:0@lo:501: 00000100:00100000:3.0:1788839175.372846:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.372906:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000222194d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788839175.373031:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074816 00000100:00100000:0.0:1788839175.373036:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074816 00000100:00100000:0.0:1788839175.373075:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839175.373082:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d5ecfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+11:5824:x1875733747074816:12345-0@lo:501: 00000100:00100000:0.0:1788839175.373624:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d5ecfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+11:5824:x1875733747074816:12345-0@lo:501: Request processed in 541us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839175.373637:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839175.373879:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074816:0@lo:501: 00000100:00100000:3.0:1788839175.373911:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074944:0@lo:503: 00000100:00100000:3.0:1788839175.373951:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.373985:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000222194d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788839175.374080:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747074944 00000100:00100000:1.0:1788839175.374084:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747074944 00000100:00100000:1.0:1788839175.374113:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839175.374120:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049b73386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:5824:x1875733747074944:12345-0@lo:503: 00000040:00080000:1.0:1788839175.374156:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839175.374192:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049b73386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:5824:x1875733747074944:12345-0@lo:503: Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839175.374198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839175.374374:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747074944:0@lo:503: 00000040:00080000:0.0:1788839175.375526:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788839175.376013:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788839175.376032:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839175.376254:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.376267:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839175.376309:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788839175.376312:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eb02d49000 10000000:01000000:3.0:1788839175.376314:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eb02d49000 10000000:01000000:3.0:1788839175.376318:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839175.376334:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb02d49000 from 1 10000000:01000000:3.0:1788839175.376336:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839175.376367:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000653d76c1/0x4b63896d6363fa0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.376375:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000653d76c1/0x4b63896d6363fa0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.376385:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000653d76c1/0x4b63896d6363fa0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839175.376406:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075072:0@lo:101: 00000100:00100000:3.0:1788839175.376466:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.376496:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a645236 going to sleep for 11 seconds 00000100:00100000:1.0:1788839175.376565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075072 00000100:00100000:1.0:1788839175.376572:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075072 00000100:00100000:1.0:1788839175.376616:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839175.376624:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001e89896 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:5824:x1875733747075072:12345-0@lo:101: 00010000:00010000:1.0:1788839175.376635:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839175.376646:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000cf20bae/0x4b63896d6363fa16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fa0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.376666:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000cf20bae/0x4b63896d6363fa16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.376683:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000cf20bae/0x4b63896d6363fa16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.376691:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000cf20bae, rc 0) 00000100:00100000:1.0:1788839175.376729:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001e89896 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:5824:x1875733747075072:12345-0@lo:101: Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839175.376735:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839175.376942:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075072:0@lo:101: 00010000:00010000:3.0:1788839175.376957:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000653d76c1/0x4b63896d6363fa0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839175.376965:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000653d76c1/0x4b63896d6363fa0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839175.377010:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075200:0@lo:501: 00000100:00100000:3.0:1788839175.377036:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.377079:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a645236 going to sleep for 11 seconds 00000100:00100000:1.0:1788839175.377136:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075200 00000100:00100000:1.0:1788839175.377140:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075200 00000100:00100000:1.0:1788839175.377170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788839175.377177:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc0267bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:5824:x1875733747075200:12345-0@lo:501: 00000100:00100000:1.0:1788839175.377415:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc0267bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:5824:x1875733747075200:12345-0@lo:501: Request processed in 238us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839175.377422:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839175.377497:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075200:0@lo:501: 00000100:00100000:3.0:1788839175.377524:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075328:0@lo:503: 00000100:00100000:3.0:1788839175.377561:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.377589:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a645236 going to sleep for 11 seconds 00000100:00100000:1.0:1788839175.377647:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075328 00000100:00100000:1.0:1788839175.377651:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075328 00000100:00100000:1.0:1788839175.377681:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788839175.377687:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002462a75a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5824:x1875733747075328:12345-0@lo:503: 00000100:00100000:1.0:1788839175.378007:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002462a75a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5824:x1875733747075328:12345-0@lo:503: Request processed in 321us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839175.378015:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788839175.378074:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c282e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075328:0@lo:503: 00000100:00100000:2.0:1788839175.379029:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3690601 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5870:1875733747075456:0@lo:502: 00000100:00100000:2.0:1788839175.379114:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839175.379150:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc623e7d going to sleep for 11 seconds 00000100:00100000:3.0:1788839175.379275:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075456 00000100:00100000:3.0:1788839175.379282:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075456 00000100:00100000:3.0:1788839175.379320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839175.379326:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000460e86e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:5870:x1875733747075456:12345-0@lo:502: 00000100:00100000:3.0:1788839175.379567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000460e86e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:5870:x1875733747075456:12345-0@lo:502: Request processed in 241us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839175.379575:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839175.379700:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3690601 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5870:1875733747075456:0@lo:502: 00000020:01000004:2.0:1788839175.379770:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788839175.379890:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000544f1f0e) 00000020:00000080:2.0:1788839175.379912:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788839175.380002:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004886a743 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788839175.380006:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004886a743 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788839175.380008:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004886a743 4 00010000:00080000:2.0:1788839175.380036:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005e701f8b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:2.0:1788839175.381999:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788839175.382735:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788839175.382881:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839175.382896:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b63896d6363fa24 00000100:00080000:3.0:1788839175.382906:0:5870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839175.382910:0:5870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e701f8b using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1788839175.382943:0:5870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000022f9eed8 x1875733747075584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839175.382999:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022f9eed8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747075584:0@lo:38: 00000100:00100000:2.0:1788839175.383090:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839175.383161:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788839175.383381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075584 00000100:00100000:0.0:1788839175.383388:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075584 00000100:00100000:0.0:1788839175.383418:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839175.383424:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3690601 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875733747075584:12345-0@lo:38: 00000100:00100000:0.0:1788839175.385686:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3690601 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875733747075584:12345-0@lo:38: Request processed in 2253us (2588us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788839175.385701:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839175.386014:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839175.386022:0:3310:0:(import.c:65:import_set_state_nolock()) 000000005e701f8b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839175.386027:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788839175.386030:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022f9eed8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747075584:0@lo:38: 00000100:00100000:3.0:1788839175.386285:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5870:1875733747075712:0@lo:502: 00000100:00100000:3.0:1788839175.386363:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839175.386396:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075712 00000100:00100000:3.0:1788839175.386402:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075712 00000100:00100000:3.0:1788839175.386435:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839175.386443:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf648a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:5870:x1875733747075712:12345-0@lo:502: 00000100:00100000:3.0:1788839175.386665:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf648a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:5870:x1875733747075712:12345-0@lo:502: Request processed in 223us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839175.386672:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839175.386726:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a645236 going to sleep for 11 seconds 00000100:00100000:3.0:1788839175.386757:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:5870:1875733747075712:0@lo:502: 00000040:00080000:3.0:1788839175.386779:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788839175.387000:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788839175.387019:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839175.387041:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000653d76c1/0x4b63896d6363fa0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.387088:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000653d76c1/0x4b63896d6363fa0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788839175.387133:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788839175.387136:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788839175.387137:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839175.387139:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839175.387140:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839175.387141:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839175.387143:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788839175.387144:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788839175.387145:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788839175.387147:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788839175.387148:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839175.387150:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839175.387154:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788839175.387157:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839175.387158:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788839175.387159:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839175.387160:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839175.387161:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839175.387163:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839175.387163:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788839175.387164:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788839175.387166:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788839175.387166:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788839175.387167:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839175.387168:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839175.387194:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788839175.387215:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e08e1c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075840:0@lo:253: 00000100:00100000:1.0:1788839175.387255:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839175.387275:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a16aa894 going to sleep for 11 seconds 00000100:00100000:1.0:1788839175.387292:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075840 00000100:00100000:1.0:1788839175.387296:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075840 00000100:00100000:1.0:1788839175.387324:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839175.387335:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3d0a5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5824:x1875733747075840:12345-0@lo:253: 20000000:01000000:1.0:1788839175.387356:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788839175.387368:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788839175.427258:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788839175.427280:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788839175.427326:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839175.427332:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839175.427354:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839175.427376:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839175.427386:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839175.427428:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839175.427459:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 12 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839175.427474:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000844b62d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875733747075968:0@lo:104: 00000100:00100000:2.0:1788839175.427543:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839175.427606:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5bbbb84 going to sleep for 11 seconds 00000100:00100000:1.0:1788839175.427725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747075968 00000100:00100000:1.0:1788839175.427732:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747075968 00000100:00100000:1.0:1788839175.427907:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839175.427917:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feb37ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:5858:x1875733747075968:12345-0@lo:104: 00010000:00010000:1.0:1788839175.427931:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.427994:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839175.427999:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feb37ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:5858:x1875733747075968:12345-0@lo:104: Request processed in 85us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839175.428006:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788839175.428041:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839175.428046:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428080:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006bd4ffe9 already unused, calling callback (0000000054cc24ea) 10000000:00010000:1.0:1788839175.428083:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428090:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839175.428096:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839175.428111:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839175.428138:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428144:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839175.428160:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428165:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: 000000006bd4ffe9/0x4b63896d6363f9f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f9fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428179:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839175.428181:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839175.428182:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839175.428261:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a688971 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747076096:0@lo:103: 00000100:00100000:1.0:1788839175.428291:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839175.428366:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076096 00000100:00100000:1.0:1788839175.428370:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076096 00010000:00010000:1.0:1788839175.428386:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 13 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839175.428407:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839175.428413:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd74e764 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+13:3312:x1875733747076096:12345-0@lo:103: 00010000:00010000:1.0:1788839175.428423:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839175.428428:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 13 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428437:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 13 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428458:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428465:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839175.428476:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001145604s 00010000:00010000:1.0:1788839175.428480:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428485:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428491:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428496:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.428500:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af47515e already unused, calling callback (000000009f01d2e6) 00010000:00010000:2.0:1788839175.428947:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060dc0a23/0x4b63896d6363f9fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363f9f3 expref: 13 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839175.428960:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000844b62d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875733747075968:0@lo:104: 00010000:00010000:2.0:1788839175.428976:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839175.428985:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839175.428990:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.429622:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.429633:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.429646:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.429654:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af47515e/0x4b63896d6363fa2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839175.429687:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839175.429762:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd74e764 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+12:3312:x1875733747076096:12345-0@lo:103: Request processed in 1349us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839175.429770:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839175.429996:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a688971 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747076096:0@lo:103: 00000100:00100000:3.0:1788839175.437339:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3d0a5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+11:5824:x1875733747075840:12345-0@lo:253: Request processed in 49995us (50075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839175.437356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839175.437447:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e08e1c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:5824:1875733747075840:0@lo:253: 10000000:01000000:1.0:1788839175.437463:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788839175.437466:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788839175.437468:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788839175.437469:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839175.437471:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839175.437472:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839175.437473:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839175.437474:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788839175.437476:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788839175.437477:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788839175.437478:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788839175.437480:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839175.437481:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788839175.437495:0:5824:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788839175.442517:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839175.443001:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788839175.443251:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839175.443410:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788839175.443584:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839175.443751:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788839175.446351:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839175.446527:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788839175.446712:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839175.447166:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788839175.447381:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839175.447562:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788839175.491619:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788839175.527733:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788839175.528135:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788839175.530775:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788839175.530939:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788839175.531419:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788839175.531428:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788839175.531554:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788839175.533000:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788839175.533009:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788839175.533521:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788839175.535109:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788839175.535175:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788839175.535488:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788839175.536126:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788839175.538280:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788839175.538438:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788839175.538913:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788839175.539095:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788839175.539268:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788839175.539430:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788839175.539931:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788839175.540101:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788839175.540286:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788839175.540458:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788839175.540890:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788839175.541164:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788839175.541417:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788839175.541632:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788839175.541900:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788839175.542103:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788839175.542461:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788839175.545432:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788839175.545722:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00010000:00010000:3.0:1788839175.550745:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788839175.551278:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788839175.551464:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788839175.551967:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788839175.557024:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788839175.557265:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788839175.557407:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788839175.557542:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788839175.562404:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788839175.562725:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788839175.563141:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788839175.563298:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788839175.563449:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788839175.564189:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788839175.564441:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788839175.596234:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788839175.663300:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788839175.663342:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb2441a03988 00100000:10000000:3.0:1788839175.663365:0:5824:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788839175.666712:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788839175.666730:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788839175.666754:0:5824:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788839175.666770:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788839175.672082:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788839175.672171:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788839175.672176:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788839176.581838:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839177.597199:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839178.624098:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839179.645211:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839180.106989:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788839180.606208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788839180.606218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788839180.606221:0:36:0:(import.c:65:import_set_state_nolock()) 000000005e701f8b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839180.606234:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e701f8b using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1788839180.606256:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009a55dc10 x1875733747076352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839180.606332:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839180.606346:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747076224:0@lo:400: 00000100:00100000:3.0:1788839180.606425:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839180.606491:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076224 00000100:00100000:3.0:1788839180.606498:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076224 00000100:00100000:3.0:1788839180.606540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839180.606548:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059353216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:3314:x1875733747076224:12345-0@lo:400: 00000100:00100000:3.0:1788839180.606601:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059353216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:3314:x1875733747076224:12345-0@lo:400: Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839180.606608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839180.606653:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747076224:0@lo:400: 00000100:00100000:2.0:1788839180.606788:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a55dc10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747076352:0@lo:38: 00000100:00100000:2.0:1788839180.606835:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839180.607119:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076352 00000100:00100000:3.0:1788839180.607123:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076352 00000100:00100000:3.0:1788839180.607174:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839180.607179:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000844b62d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875733747076352:12345-0@lo:38: 00010000:00080000:3.0:1788839180.607199:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:3.0:1788839180.607231:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b63896d6363fa32 00000004:00100000:3.0:1788839180.607285:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788839180.607407:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000e72ad95f : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839180.607453:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000844b62d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875733747076352:12345-0@lo:38: Request processed in 273us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839180.607460:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788839180.610819:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009a55dc10 x1875733747076352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839180.610845:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788839180.610856:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788839180.610862:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788839180.610865:0:3310:0:(import.c:65:import_set_state_nolock()) 000000005e701f8b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788839180.610873:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a55dc10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747076352:0@lo:38: 00010000:00010000:0.0:1788839180.669372:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839181.693620:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839182.717138:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788839183.165106:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788839183.165115:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eb02d49000 from 3 10000000:01000000:1.0:1788839183.165120:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788839183.165173:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000da32c162/0x4b63896d6363fa39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839183.165195:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000da32c162/0x4b63896d6363fa39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839183.165204:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000da32c162/0x4b63896d6363fa39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839183.165244:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e08e1c64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747076480:0@lo:101: 00000100:00100000:1.0:1788839183.165318:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839183.165382:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d62501fa going to sleep for 11 seconds 00000100:00100000:3.0:1788839183.166985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076480 00000100:00100000:3.0:1788839183.166998:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076480 00000100:00100000:3.0:1788839183.167615:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839183.167628:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009055bcee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+11:5840:x1875733747076480:12345-0@lo:101: 00010000:00010000:3.0:1788839183.167659:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839183.167682:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc3477b5/0x4b63896d6363fa40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fa39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839183.167714:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc3477b5/0x4b63896d6363fa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839183.167727:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc3477b5/0x4b63896d6363fa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839183.167736:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc3477b5, rc 0) 00000100:00100000:3.0:1788839183.167828:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009055bcee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747076480:12345-0@lo:101: Request processed in 203us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839183.167834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839183.168027:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e08e1c64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747076480:0@lo:101: 00010000:00010000:2.0:1788839183.168085:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000da32c162/0x4b63896d6363fa39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839183.168095:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000da32c162/0x4b63896d6363fa39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839183.168172:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004450aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747076608:0@lo:256: 00000100:00100000:2.0:1788839183.168227:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839183.168259:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077a2218f going to sleep for 11 seconds 00000100:00100000:1.0:1788839183.168637:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076608 00000100:00100000:1.0:1788839183.168644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076608 00000100:00100000:1.0:1788839183.168695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839183.168702:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a63ceeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747076608:12345-0@lo:256: 20000000:01000000:1.0:1788839183.168718:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788839183.168735:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788839183.168738:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788839183.168817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a63ceeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747076608:12345-0@lo:256: Request processed in 116us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839183.168824:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839183.168856:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004450aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747076608:0@lo:256: 10000000:01000000:1.0:1788839183.168892:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839183.168898:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000da32c162/0x4b63896d6363fa39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839183.168907:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000da32c162/0x4b63896d6363fa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839183.741417:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788839184.454292:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbf2472f0 20000000:00000080:3.0:1788839184.454310:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eb10282800 uarg=0000000000000000 20000000:01000000:3.0:1788839184.454345:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788839184.454352:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788839184.454357:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788839184.454652:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788839184.454672:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788839184.458775:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839184.459357:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788839184.459422:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788839184.459469:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788839184.459491:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788839184.459514:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839184.459535:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839184.459543:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839184.459584:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839184.459598:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 11 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839184.459613:0:6320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875733747076736:0@lo:104: 00000100:00100000:3.0:1788839184.459698:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839184.459756:0:6320:0:(client.c:2715:ptlrpc_set_wait()) set 00000000677c4569 going to sleep for 11 seconds 00000100:00100000:0.0:1788839184.459875:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076736 00000100:00100000:0.0:1788839184.459884:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076736 00000100:00100000:0.0:1788839184.459937:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839184.459946:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000422a4297 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:6320:x1875733747076736:12345-0@lo:104: 00010000:00010000:0.0:1788839184.459960:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460033:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839184.460039:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000422a4297 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:6320:x1875733747076736:12345-0@lo:104: Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839184.460075:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788839184.460099:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839184.460105:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460127:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b4fc088b already unused, calling callback (0000000054cc24ea) 10000000:00010000:0.0:1788839184.460130:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460138:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839184.460144:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839184.460149:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839184.460177:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460184:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839184.460202:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460208:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: 00000000b4fc088b/0x4b63896d6363fa01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa08 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460226:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839184.460228:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839184.460229:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839184.460247:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9387c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747076864:0@lo:103: 00000100:00100000:0.0:1788839184.460277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839184.460313:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076864 00000100:00100000:0.0:1788839184.460317:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076864 00010000:00010000:0.0:1788839184.460332:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 12 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839184.460362:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839184.460368:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcb6daba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+12:3314:x1875733747076864:12345-0@lo:103: 00010000:00010000:0.0:1788839184.460379:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839184.460382:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 12 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460391:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 12 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460405:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460411:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460422:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460428:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460433:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460438:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460444:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000349b5d2a already unused, calling callback (000000009f01d2e6) 00010000:00010000:0.0:1788839184.460447:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460460:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460468:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839184.460476:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839184.460503:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcb6daba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+12:3314:x1875733747076864:12345-0@lo:103: Request processed in 136us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839184.460510:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839184.460543:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9387c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747076864:0@lo:103: 00010000:00010000:3.0:1788839184.460795:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d38d67e/0x4b63896d6363fa08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fa01 expref: 11 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839184.460806:0:6320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875733747076736:0@lo:104: 00010000:00010000:3.0:1788839184.460818:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839184.460825:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839184.460837:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839184.460842:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000349b5d2a/0x4b63896d6363fa47 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839184.765303:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839185.726715:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747076992:0@lo:400: 00000100:00100000:1.0:1788839185.726792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839185.727337:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839185.727344:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a27a1ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747077120:0@lo:400: 00000100:00100000:1.0:1788839185.727383:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839185.727471:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747076992 00000100:00100000:1.0:1788839185.727479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747076992 00000100:00100000:1.0:1788839185.727533:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839185.727543:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2225670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:3311:x1875733747076992:12345-0@lo:400: 00000100:00100000:1.0:1788839185.727595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2225670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:3311:x1875733747076992:12345-0@lo:400: Request processed in 54us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839185.727691:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839185.727738:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c577aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747076992:0@lo:400: 00000100:00100000:0.0:1788839185.728015:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747077120 00000100:00100000:0.0:1788839185.728028:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747077120 00000100:00100000:0.0:1788839185.728092:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839185.728100:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000126c4ed8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747077120:12345-0@lo:400: 00000100:00100000:0.0:1788839185.728144:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000126c4ed8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747077120:12345-0@lo:400: Request processed in 46us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839185.728151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788839185.728221:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004a27a1ec x1875733747077120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839185.728233:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a27a1ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747077120:0@lo:400: 00010000:00010000:0.0:1788839185.792691:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839186.816675:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839187.837176:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839188.870342:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788839189.314810:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788839189.314820:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02d49000 from 1 10000000:01000000:1.0:1788839189.314826:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839189.314876:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 0000000023e78571/0x4b63896d6363fa4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839189.314889:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 0000000023e78571/0x4b63896d6363fa4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839189.314900:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 0000000023e78571/0x4b63896d6363fa4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839189.314922:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002969ce6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747077248:0@lo:101: 00000100:00100000:1.0:1788839189.315003:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839189.315076:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053b8f2b1 going to sleep for 11 seconds 00000100:00100000:0.0:1788839189.315739:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747077248 00000100:00100000:0.0:1788839189.315747:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747077248 00000100:00100000:0.0:1788839189.315803:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839189.315812:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0078314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+11:5840:x1875733747077248:12345-0@lo:101: 00010000:00010000:0.0:1788839189.315826:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839189.315839:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f543432/0x4b63896d6363fa55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fa4e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839189.315876:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f543432/0x4b63896d6363fa55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839189.315885:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f543432/0x4b63896d6363fa55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839189.315893:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f543432, rc 0) 00000100:00100000:0.0:1788839189.315939:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0078314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747077248:12345-0@lo:101: Request processed in 129us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839189.315946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839189.316428:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002969ce6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747077248:0@lo:101: 00010000:00010000:1.0:1788839189.316445:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 0000000023e78571/0x4b63896d6363fa4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839189.316460:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 0000000023e78571/0x4b63896d6363fa4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839189.319746:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002969ce6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747077376:0@lo:501: 00000100:00100000:1.0:1788839189.319833:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839189.319871:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053b8f2b1 going to sleep for 11 seconds 00000100:00100000:0.0:1788839189.320940:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747077376 00000100:00100000:0.0:1788839189.320953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747077376 00000100:00100000:0.0:1788839189.321022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839189.321030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c86bbea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747077376:12345-0@lo:501: 00000100:00100000:0.0:1788839189.321442:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c86bbea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747077376:12345-0@lo:501: Request processed in 412us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839189.321450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788839189.323933:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002969ce6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747077376:0@lo:501: 00000100:00100000:1.0:1788839189.324006:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002969ce6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747077504:0@lo:503: 00000100:00100000:1.0:1788839189.324108:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839189.324163:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053b8f2b1 going to sleep for 11 seconds 00000100:00100000:1.0:1788839189.324185:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747077504 00000100:00100000:1.0:1788839189.324191:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747077504 00000100:00100000:1.0:1788839189.324238:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788839189.324248:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b741585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747077504:12345-0@lo:503: 00000100:00100000:1.0:1788839189.325723:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b741585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747077504:12345-0@lo:503: Request processed in 1471us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839189.325738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788839189.325822:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002969ce6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747077504:0@lo:503: 00000100:00100000:0.0:1788839189.330484:0:6630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9387c84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:6630:1875733747077632:0@lo:502: 00000100:00100000:0.0:1788839189.330841:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839189.331073:0:6630:0:(client.c:2715:ptlrpc_set_wait()) set 00000000876a91bc going to sleep for 11 seconds 00000100:00100000:1.0:1788839189.331142:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747077632 00000100:00100000:1.0:1788839189.331151:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747077632 00000100:00100000:1.0:1788839189.331202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839189.331213:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000364d3aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:6630:x1875733747077632:12345-0@lo:502: 00000100:00100000:0.0:1788839189.332044:0:6630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9387c84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:6630:1875733747077632:0@lo:502: 00000020:01000000:0.0:1788839189.332114:0:6630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839189.332123:0:6630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839189.332126:0:6630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788839189.332134:0:6630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb02d49000 00000020:00000080:0.0:1788839189.332137:0:6630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788839189.332191:0:6630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:6630:1875733747077760:0@lo:502: 00000100:00100000:1.0:1788839189.332347:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:6630:x1875733747077632:12345-0@lo:502: Request processed in 686us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839189.332356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839189.332420:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839189.332481:0:6630:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8c8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788839189.332745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747077760 00000100:00100000:1.0:1788839189.332752:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747077760 00000100:00100000:1.0:1788839189.332819:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839189.332829:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6630:x1875733747077760:12345-0@lo:502: 00000100:00100000:1.0:1788839189.333199:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6630:x1875733747077760:12345-0@lo:502: Request processed in 371us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839189.333207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788839189.335152:0:6630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:6630:1875733747077760:0@lo:502: 00000020:01000000:0.0:1788839189.335196:0:6630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839189.335207:0:6630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839189.335209:0:6630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788839189.335213:0:6630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788839189.335774:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788839189.335802:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839189.335814:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839189.335825:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839189.885264:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839190.850919:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747077888:0@lo:400: 00000100:00100000:2.0:1788839190.851011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839190.851800:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839190.851810:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747078016:0@lo:400: 00000100:00100000:2.0:1788839190.851850:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839190.851892:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747077888 00000100:00100000:2.0:1788839190.851901:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747077888 00000100:00100000:2.0:1788839190.851959:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839190.851969:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:3313:x1875733747077888:12345-0@lo:400: 00000100:00100000:2.0:1788839190.852033:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:3313:x1875733747077888:12345-0@lo:400: Request processed in 65us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839190.852312:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839190.852364:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747077888:0@lo:400: 00000100:00100000:1.0:1788839190.852542:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078016 00000100:00100000:1.0:1788839190.852547:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078016 00000100:00100000:1.0:1788839190.852590:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839190.852598:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747078016:12345-0@lo:400: 00000100:00100000:1.0:1788839190.852642:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747078016:12345-0@lo:400: Request processed in 44us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839190.852648:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788839190.852811:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eb3375d500 x1875733747078016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839190.852824:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747078016:0@lo:400: 00010000:00010000:0.0:1788839190.909329:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788839190.955661:0:6693:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788839190.955666:0:6693:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788839190.955815:0:6693:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eb3bf58000 00000020:01000004:1.0:1788839190.955832:0:6693:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788839190.955843:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788839190.955856:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91eb09e0b370) 00000020:00000080:1.0:1788839190.955872:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788839190.976640:0:6693:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788839190.976924:0:6693:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788839191.002263:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788839191.011177:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788839191.011212:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788839191.011270:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788839191.011299:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788839191.011758:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788839191.011770:0:6693:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788839191.011782:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b63896d6363fa63 00000020:01000004:1.0:1788839191.011789:0:6693:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788839191.011810:0:6693:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788839191.011814:0:6693:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788839191.011820:0:6693:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788839191.011825:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788839191.011837:0:6693:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91eb09e099b8) 00000020:00000080:1.0:1788839191.011848:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788839191.016256:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839191.016485:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788839191.016500:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788839191.020023:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788839191.020070:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788839191.020433:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788839191.020440:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788839191.022393:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839191.022641:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788839191.022649:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788839191.024368:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788839191.024381:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788839191.067479:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839191.067883:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788839191.067974:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788839191.069403:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788839191.069413:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788839191.072158:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788839191.072177:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788839191.076752:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839191.079461:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788839191.079475:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788839191.080353:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788839191.080361:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788839191.128839:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839191.129464:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788839191.129471:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788839191.131239:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788839191.131250:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788839191.131624:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788839191.131649:0:6693:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788839191.131655:0:6693:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788839191.148460:0:6693:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839191.148498:0:6693:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788839191.148502:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839191.148504:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839191.148505:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839191.148507:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839191.148508:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839191.148509:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839191.148511:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839191.148512:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788839191.148513:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788839191.148515:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839191.148520:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839191.148525:0:6693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788839191.148527:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839191.148528:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839191.148529:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839191.148529:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839191.148530:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839191.148531:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839191.148532:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839191.148533:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788839191.148534:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788839191.148535:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839191.148536:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839191.148563:0:6693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788839191.148582:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747078144:0@lo:253: 00000100:00100000:3.0:1788839191.148662:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.148784:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788839191.148867:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078144 00000100:00100000:1.0:1788839191.148874:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078144 00000100:00100000:1.0:1788839191.149034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839191.149045:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747078144:12345-0@lo:253: 20000000:01000000:1.0:1788839191.149091:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788839191.149095:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788839191.149100:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788839191.149104:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788839191.149895:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839191.150125:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788839191.150139:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788839191.150177:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788839191.150194:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788839191.150229:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788839191.150277:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788839191.151033:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788839191.151091:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:1.0:1788839191.151094:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:1.0:1788839191.151131:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788839191.151141:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788839191.151190:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788839191.151198:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:1.0:1788839191.151231:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788839191.151241:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788839191.151271:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788839191.151340:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788839191.152093:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788839191.152112:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:1.0:1788839191.152113:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:1.0:1788839191.152148:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788839191.152156:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788839191.152187:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788839191.152194:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:1.0:1788839191.152242:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788839191.152252:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788839191.152286:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788839191.152325:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788839191.152342:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788839191.152345:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788839191.152351:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788839191.152353:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788839191.152355:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788839191.152367:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788839191.152376:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788839191.152412:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788839191.152414:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788839191.153299:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788839191.153581:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788839191.153627:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788839191.153695:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788839191.153710:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788839191.153713:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788839191.154681:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788839191.154746:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788839191.154798:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788839191.155345:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788839191.155385:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788839191.155462:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788839191.155477:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788839191.155479:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788839191.156013:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1788839191.156130:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1788839191.156180:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788839191.156449:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788839191.156491:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788839191.156528:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1788839191.156547:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788839191.156565:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.156583:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb14529600/0x4b63896d6363f98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363f983 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.156592:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20964e00/0x4b63896d6363f9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363f99f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.156610:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fa16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.156617:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.156653:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fa16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.156668:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fa16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839191.156682:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1875733747078272:0@lo:104: 00000100:00100000:0.0:1788839191.156750:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839191.156847:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20964e00/0x4b63896d6363f9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363f99f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.156855:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20964e00/0x4b63896d6363f9a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363f99f expref: 12 pid: 5836 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839191.156863:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1875733747078400:0@lo:104: 00000100:00100000:0.0:1788839191.156978:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839191.157099:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb14529600/0x4b63896d6363f98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363f983 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.157108:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb14529600/0x4b63896d6363f98a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363f983 expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839191.157117:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1875733747078528:0@lo:104: 00000100:00100000:0.0:1788839191.157148:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839191.157403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078272 00000100:00100000:1.0:1788839191.157411:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078272 00000100:00100000:1.0:1788839191.157446:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078400 00000100:00100000:1.0:1788839191.157449:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078400 00000100:00100000:1.0:1788839191.157464:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839191.157474:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+4:5836:x1875733747078272:12345-0@lo:104: 00010000:00010000:1.0:1788839191.157487:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.157576:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839191.157583:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+4:5836:x1875733747078272:12345-0@lo:104: Request processed in 111us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839191.157591:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839191.157610:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839191.157618:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:5836:x1875733747078400:12345-0@lo:104: 00010000:00010000:1.0:1788839191.157626:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839191.157686:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0a0f0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.157706:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1875733747078272:0@lo:104: 00000100:00100000:0.0:1788839191.157714:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1875733747078400:0@lo:104: 00000100:00100000:2.0:1788839191.157759:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078528 00000100:00100000:2.0:1788839191.157764:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078528 00010000:00010000:3.0:1788839191.157807:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839191.157814:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.157822:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529000 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839191.157825:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.157834:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839191.157842:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839191.157848:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839191.158013:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158032:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788839191.158125:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747078656:0@lo:103: 00000100:00100000:0.0:1788839191.158158:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.158218:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078656 00000100:00100000:2.0:1788839191.158223:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078656 00010000:00010000:2.0:1788839191.158243:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fa16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839191.158267:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839191.158274:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+13:3311:x1875733747078656:12345-0@lo:103: 00010000:00010000:2.0:1788839191.158285:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839191.158290:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fa16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.158313:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fa16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.158327:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fa16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fa0f expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.158340:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839191.158398:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158406:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fa0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa16 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158417:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839191.158421:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158427:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529800 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839191.158430:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158436:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839191.158443:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839191.158448:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839191.158470:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158476:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839191.158545:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788839191.158553:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+4:5836:x1875733747078400:12345-0@lo:104: Request processed in 935us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839191.158559:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839191.158578:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839191.158587:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:5836:x1875733747078528:12345-0@lo:104: 00010000:00010000:1.0:1788839191.158596:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.158639:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839191.158645:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:5836:x1875733747078528:12345-0@lo:104: Request processed in 61us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839191.158651:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839191.158718:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+12:3311:x1875733747078656:12345-0@lo:103: Request processed in 443us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839191.158724:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839191.158767:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747078656:0@lo:103: 00000100:00100000:0.0:1788839191.158782:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839191.158787:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747078784:0@lo:103: 00000100:00100000:0.0:1788839191.158809:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839191.158906:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158914:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363f99f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f9a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158940:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839191.158943:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158949:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965a00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839191.158952:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158958:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839191.158963:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839191.158967:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839191.158981:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.158986:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839191.158998:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.159004:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363f983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363f98a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.159017:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839191.159019:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839191.159021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839191.159173:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747078912:0@lo:103: 00000100:00100000:2.0:1788839191.159200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839191.159375:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078784 00000100:00100000:1.0:1788839191.159381:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078784 00010000:00010000:1.0:1788839191.159399:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20964e00/0x4b63896d6363f9a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363f99f expref: 12 pid: 5836 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.159413:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747078912 00000100:00100000:1.0:1788839191.159415:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747078912 00010000:00010000:1.0:1788839191.159423:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb14529600/0x4b63896d6363f98a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363f983 expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.159433:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839191.159441:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+13:3311:x1875733747078784:12345-0@lo:103: 00010000:00010000:1.0:1788839191.159449:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839191.159454:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20964e00/0x4b63896d6363f9a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363f99f expref: 13 pid: 5836 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.159463:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20964e00/0x4b63896d6363f9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363f99f expref: 13 pid: 5836 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.159474:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20964e00/0x4b63896d6363f9a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363f99f expref: 13 pid: 5836 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.159485:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839191.159556:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788839191.159565:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788839191.159582:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839191.159720:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1875733747078528:0@lo:104: 00010000:00010000:0.0:1788839191.159742:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839191.159777:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839191.159784:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+12:3313:x1875733747078912:12345-0@lo:103: 00010000:00010000:0.0:1788839191.159793:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839191.159798:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb14529600/0x4b63896d6363f98a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363f983 expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159808:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb14529600/0x4b63896d6363f98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363f983 expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159818:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529600/0x4b63896d6363f98a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363f983 expref: 12 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159835:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159843:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159855:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159863:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159871:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.159877:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.159979:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+11:3311:x1875733747078784:12345-0@lo:103: Request processed in 538us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839191.159994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788839191.160044:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb00030000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839191.160087:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.160095:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.160110:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.160122:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839191.160156:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+10:3313:x1875733747078912:12345-0@lo:103: Request processed in 373us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.160171:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788839191.160190:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.160197:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.160216:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb00030000/0x4b63896d6363fa71 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788839191.160232:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788839191.162873:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747078784:0@lo:103: 00000100:00100000:2.0:1788839191.162941:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747078912:0@lo:103: 00000100:00100000:2.0:1788839191.209845:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+9:6693:x1875733747078144:12345-0@lo:253: Request processed in 60793us (61174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839191.209859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839191.210024:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747078144:0@lo:253: 10000000:01000000:3.0:1788839191.210073:0:6693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788839191.210077:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839191.210078:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839191.210080:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839191.210081:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788839191.210082:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839191.210084:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839191.210085:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839191.210087:0:6693:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788839191.210088:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839191.210089:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839191.210108:0:6693:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eb3bf58000 from lustre-OST0000 10000000:01000000:3.0:1788839191.210131:0:6693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788839191.210133:0:6693:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788839191.210140:0:6693:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eb09e08000 local copy 10000000:01000000:3.0:1788839191.210144:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839191.210179:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.210190:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.210199:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839191.210217:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079040:0@lo:101: 00000100:00100000:3.0:1788839191.210256:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.210358:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839191.210459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079040 00000100:00100000:2.0:1788839191.210466:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079040 00000100:00100000:2.0:1788839191.210604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839191.210615:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+9:6693:x1875733747079040:12345-0@lo:101: 00010000:00010000:2.0:1788839191.210628:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839191.210642:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964c00/0x4b63896d6363fa7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fa78 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.210665:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964c00/0x4b63896d6363fa7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fa78 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.210682:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964c00/0x4b63896d6363fa7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa78 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.210689:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964c00, rc 0) 00000100:00100000:2.0:1788839191.210762:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+10:6693:x1875733747079040:12345-0@lo:101: Request processed in 149us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.210818:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079040:0@lo:101: 00010000:00010000:0.0:1788839191.210830:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.210839:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839191.210957:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839191.211027:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079168:0@lo:501: 00000100:00100000:0.0:1788839191.211112:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.211149:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079168 00000100:00100000:2.0:1788839191.211154:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079168 00000100:00100000:2.0:1788839191.211183:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788839191.211190:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+10:6693:x1875733747079168:12345-0@lo:501: 00000100:00100000:1.0:1788839191.211252:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0a0f0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788839191.211477:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+10:6693:x1875733747079168:12345-0@lo:501: Request processed in 287us (425us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839191.211484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839191.211568:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079168:0@lo:501: 10000000:01000000:1.0:1788839191.211581:0:6693:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788839191.211600:0:6693:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788839191.211604:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.211610:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.211615:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.211663:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788839191.211677:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eb3bf58000 10000000:01000000:1.0:1788839191.211681:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788839191.211684:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91eb09e08000 10000000:01000000:1.0:1788839191.211685:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788839191.211688:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91eb09e08000 from 1 10000000:01000000:1.0:1788839191.211689:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788839191.211703:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.211708:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.211713:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.211732:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079296:0@lo:101: 00000100:00100000:1.0:1788839191.211760:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839191.211784:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05005180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839191.211842:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079296 00000100:00100000:2.0:1788839191.211846:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079296 00000100:00100000:2.0:1788839191.211877:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788839191.211951:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+10:6693:x1875733747079296:12345-0@lo:101: 00010000:00010000:2.0:1788839191.211957:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839191.211966:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20965400/0x4b63896d6363fa8d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fa86 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.211976:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965400/0x4b63896d6363fa8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fa86 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.211982:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20965400/0x4b63896d6363fa8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa86 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.211995:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965400, rc 0) 00000100:00100000:2.0:1788839191.212070:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079296:12345-0@lo:101: Request processed in 120us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839191.212074:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1788839191.212145:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839191.212150:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.212156:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529800 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839191.212163:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.212169:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839191.212173:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839191.212177:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839191.212192:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.212196:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788839191.212247:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747079424:0@lo:103: 00010000:00010000:3.0:1788839191.212267:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.212275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fa78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b63896d6363fa7f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.212292:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839191.212294:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839191.212296:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839191.212342:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079296:0@lo:101: 00010000:00010000:1.0:1788839191.212353:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa8d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.212361:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fa8d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839191.212375:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:2.0:1788839191.212379:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839191.212427:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa8d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.212435:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa8d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839191.212442:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788839191.212446:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839191.212450:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788839191.212452:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788839191.212463:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.212467:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.212472:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.212485:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079552:0@lo:101: 00000100:00100000:1.0:1788839191.212503:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.212570:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079424 00000100:00100000:3.0:1788839191.212574:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079424 00000100:00100000:3.0:1788839191.212614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839191.212622:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+11:3314:x1875733747079424:12345-0@lo:103: 00010000:00010000:3.0:1788839191.212632:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839191.212643:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20964c00/0x4b63896d6363fa7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fa78 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.212664:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839191.212693:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+10:3314:x1875733747079424:12345-0@lo:103: Request processed in 72us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839191.212700:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839191.212718:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747079424:0@lo:103: 00000100:00100000:1.0:1788839191.212982:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05005180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839191.213040:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079552 00000100:00100000:2.0:1788839191.213044:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079552 00000100:00100000:2.0:1788839191.213123:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839191.213131:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+10:6693:x1875733747079552:12345-0@lo:101: 00010000:00010000:2.0:1788839191.213138:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839191.213145:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fa94 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.213156:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.213162:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.213166:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964a00, rc 0) 00000100:00100000:2.0:1788839191.213194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079552:12345-0@lo:101: Request processed in 64us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839191.213200:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788839191.213220:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079552:0@lo:101: 00010000:00010000:3.0:1788839191.213230:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.213238:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839191.213334:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079680:0@lo:501: 00000100:00100000:3.0:1788839191.213360:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.213439:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839191.213471:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079680 00000100:00100000:1.0:1788839191.213476:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079680 00000100:00100000:1.0:1788839191.213592:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839191.213600:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079680:12345-0@lo:501: 00000100:00100000:1.0:1788839191.213811:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079680:12345-0@lo:501: Request processed in 212us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839191.213818:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839191.213960:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079680:0@lo:501: 00000100:00100000:2.0:1788839191.213987:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079808:0@lo:503: 00000100:00100000:2.0:1788839191.214016:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.214032:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb03fcc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.214069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079808 00000100:00100000:0.0:1788839191.214074:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079808 00000100:00100000:0.0:1788839191.214095:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839191.214102:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079808:12345-0@lo:503: 00000100:00100000:0.0:1788839191.214234:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079808:12345-0@lo:503: Request processed in 132us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.214241:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839191.214259:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079808:0@lo:503: 00000040:00080000:2.0:1788839191.214495:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839191.214592:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079936:0@lo:502: 00000100:00100000:2.0:1788839191.214618:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.214642:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02f330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839191.214679:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747079936 00000100:00100000:3.0:1788839191.214682:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747079936 00000100:00100000:3.0:1788839191.214733:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839191.214741:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079936:12345-0@lo:502: 00000100:00100000:3.0:1788839191.214875:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747079936:12345-0@lo:502: Request processed in 135us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839191.214880:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839191.215073:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747079936:0@lo:502: 00000040:00080000:2.0:1788839191.215225:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788839191.215255:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788839191.215272:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788839191.215296:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788839191.215315:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788839191.215332:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788839191.215347:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080064:0@lo:502: 00000100:00100000:2.0:1788839191.215372:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.215620:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02f330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839191.215658:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080064 00000100:00100000:1.0:1788839191.215663:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080064 00000100:00100000:1.0:1788839191.215682:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839191.215687:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747080064:12345-0@lo:502: 00000100:00100000:1.0:1788839191.215872:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747080064:12345-0@lo:502: Request processed in 183us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839191.215938:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839191.216006:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080064:0@lo:502: 00000040:00080000:2.0:1788839191.216135:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788839191.216146:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788839191.216578:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788839191.216584:0:6712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788839191.216589:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839191.216591:0:6712:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788839191.216594:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839191.216606:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91eb10203370) 00000020:00000080:2.0:1788839191.216625:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788839191.216629:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788839191.216676:0:6712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eb3bf58000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788839191.216680:0:6712:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788839191.216685:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b63896d6363faa9 00010000:00010000:2.0:1788839191.219772:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788839191.220274:0:6712:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788839191.221870:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788839191.222165:0:6712:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788839191.228016:0:6712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788839191.228442:0:6712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788839191.229895:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788839191.229906:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839191.229912:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839191.229914:0:6712:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788839191.229917:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839191.229931:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839191.229933:0:6712:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788839191.229937:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839191.229939:0:6712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788839191.229977:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839191.229979:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839191.229979:0:6712:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788839191.229981:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788839191.230122:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788839191.230144:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788839191.230161:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.230175:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839191.230190:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb3bf58000 from 1 10000000:01000000:3.0:1788839191.230193:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839191.230226:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.230234:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.230245:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839191.230264:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080192:0@lo:101: 00000100:00100000:3.0:1788839191.230337:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839191.230378:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080192 00000100:00100000:3.0:1788839191.230384:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.230391:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080192 00000100:00100000:0.0:1788839191.230436:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788839191.230447:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+11:6693:x1875733747080192:12345-0@lo:101: 00010000:00010000:0.0:1788839191.230460:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839191.230472:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fab0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.230494:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.230503:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.230511:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb00030000, rc 0) 00000100:00100000:0.0:1788839191.230558:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080192:12345-0@lo:101: Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.230565:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839191.230607:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080192:0@lo:101: 00010000:00010000:3.0:1788839191.230622:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.230631:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839191.230698:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080320:0@lo:501: 00000100:00100000:3.0:1788839191.230718:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.230735:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.230762:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080320 00000100:00100000:0.0:1788839191.230767:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080320 00000100:00100000:0.0:1788839191.230794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788839191.230800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080320:12345-0@lo:501: 00000100:00100000:0.0:1788839191.231065:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080320:12345-0@lo:501: Request processed in 248us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.231072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788839191.231127:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080320:0@lo:501: 00000100:00100000:3.0:1788839191.231152:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080448:0@lo:503: 00000100:00100000:3.0:1788839191.231200:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.231228:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.231371:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080448 00000100:00100000:0.0:1788839191.231376:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080448 00000100:00100000:0.0:1788839191.231405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839191.231410:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080448:12345-0@lo:503: 00000100:00100000:0.0:1788839191.231569:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080448:12345-0@lo:503: Request processed in 158us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.231582:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788839191.231626:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080448:0@lo:503: 00000040:00080000:3.0:1788839191.231857:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839191.231910:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080576:0@lo:502: 00000100:00100000:3.0:1788839191.231952:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.231968:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.231991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080576 00000100:00100000:0.0:1788839191.231995:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080576 00000100:00100000:0.0:1788839191.232024:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788839191.232030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080576:12345-0@lo:502: 00000100:00100000:0.0:1788839191.232162:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080576:12345-0@lo:502: Request processed in 131us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.232169:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839191.232999:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080576:0@lo:502: 00000040:00080000:3.0:1788839191.233287:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788839191.233324:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788839191.233344:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080704:0@lo:502: 00000100:00100000:3.0:1788839191.233382:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839191.233403:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.233460:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080704 00000100:00100000:0.0:1788839191.233464:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080704 00000100:00100000:0.0:1788839191.233495:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788839191.233503:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080704:12345-0@lo:502: 00000100:00100000:0.0:1788839191.233650:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080704:12345-0@lo:502: Request processed in 143us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.233658:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839191.233681:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080704:0@lo:502: 00000040:00080000:3.0:1788839191.233759:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788839191.233768:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788839191.234298:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839191.234309:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839191.234311:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788839191.234318:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb3bf58000 00000020:00000080:3.0:1788839191.234319:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788839191.234336:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839191.234338:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839191.234339:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788839191.234341:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788839191.234471:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788839191.234491:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839191.234520:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.234531:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839191.234581:0:6693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788839191.234583:0:6693:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eb3bf58000 10000000:01000000:2.0:1788839191.234587:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eb3bf58000 10000000:01000000:2.0:1788839191.234591:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839191.234597:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb3bf58000 from 1 10000000:01000000:2.0:1788839191.234600:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839191.234627:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.234636:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.234644:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839191.234660:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080832:0@lo:101: 00000100:00100000:2.0:1788839191.234706:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.234777:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e37240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839191.234868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080832 00000100:00100000:3.0:1788839191.234874:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080832 00000100:00100000:3.0:1788839191.234941:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788839191.234958:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747080832:12345-0@lo:101: 00010000:00010000:3.0:1788839191.234970:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839191.234983:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fabe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.235006:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fabe expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.235017:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fabe expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839191.235027:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14529000, rc 0) 00000100:00100000:3.0:1788839191.235093:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747080832:12345-0@lo:101: Request processed in 137us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839191.235100:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788839191.235192:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080832:0@lo:101: 00010000:00010000:0.0:1788839191.235206:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.235215:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839191.235298:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080960:0@lo:501: 00000100:00100000:0.0:1788839191.235327:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839191.235623:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb064440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839191.235653:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747080960 00000100:00100000:2.0:1788839191.235658:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747080960 00000100:00100000:2.0:1788839191.235684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839191.235690:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747080960:12345-0@lo:501: 00000100:00100000:2.0:1788839191.235916:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747080960:12345-0@lo:501: Request processed in 224us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839191.235940:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788839191.236324:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747080960:0@lo:501: 00000100:00100000:0.0:1788839191.236364:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081088:0@lo:503: 00000100:00100000:0.0:1788839191.236405:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839191.236468:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb064440c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839191.236577:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081088 00000100:00100000:2.0:1788839191.236583:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081088 00000100:00100000:2.0:1788839191.236648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839191.236664:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747081088:12345-0@lo:503: 00000100:00100000:2.0:1788839191.236828:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747081088:12345-0@lo:503: Request processed in 165us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839191.236835:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788839191.236907:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081088:0@lo:503: 00000040:00080000:0.0:1788839191.237198:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839191.237267:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081216:0@lo:502: 00000100:00100000:0.0:1788839191.237305:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839191.237475:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb064440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839191.237573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081216 00000100:00100000:3.0:1788839191.237578:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081216 00000100:00100000:3.0:1788839191.237604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788839191.237611:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747081216:12345-0@lo:502: 00000100:00100000:3.0:1788839191.237779:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747081216:12345-0@lo:502: Request processed in 168us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839191.237786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788839191.237900:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081216:0@lo:502: 00000040:00080000:0.0:1788839191.238264:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788839191.238313:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788839191.238348:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788839191.238408:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788839191.238446:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788839191.238492:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788839191.238610:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788839191.238648:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788839191.238700:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788839191.238753:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788839191.238791:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788839191.238844:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788839191.238885:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788839191.238933:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788839191.238982:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788839191.239021:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788839191.239169:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788839191.239221:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788839191.239254:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788839191.239282:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788839191.239344:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788839191.239379:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788839191.239414:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788839191.239460:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788839191.239496:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788839191.239623:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788839191.239675:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788839191.239711:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788839191.239753:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081344:0@lo:502: 00000100:00100000:0.0:1788839191.239821:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839191.239914:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb064440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839191.240027:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081344 00000100:00100000:3.0:1788839191.240035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081344 00000100:00100000:3.0:1788839191.240248:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788839191.240258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747081344:12345-0@lo:502: 00000100:00100000:3.0:1788839191.240525:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747081344:12345-0@lo:502: Request processed in 267us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839191.240541:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788839191.240687:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081344:0@lo:502: 00000040:00080000:0.0:1788839191.240764:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788839191.240775:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788839191.241289:0:6717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788839191.241304:0:6717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91eb0f903370) 00000020:00000080:0.0:1788839191.241322:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788839191.241400:0:6717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eb3bf58000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788839191.241404:0:6717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eb3bf58000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788839191.241407:0:6717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb3bf58000 3 00010000:00080000:0.0:1788839191.241444:0:6717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb373f7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1788839191.244365:0:6717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788839191.244619:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788839191.244656:0:6717:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788839191.244670:0:6717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b63896d6363fad3 00000100:00080000:0.0:1788839191.244679:0:6717:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788839191.244685:0:6717:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91eb373f7000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839191.244737:0:6717:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb0f8f9880 x1875733747081472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839191.244869:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875733747081472:0@lo:38: 00000100:00100000:3.0:1788839191.244949:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839191.245013:0:6717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788839191.245368:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1788839191.246174:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081472 00000100:00100000:3.0:1788839191.246183:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081472 00000100:00100000:3.0:1788839191.246258:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839191.246266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875733747081472:12345-0@lo:38: 00010000:00080000:3.0:1788839191.246292:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1788839191.246325:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b63896d6363fada 00000004:00100000:3.0:1788839191.246340:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788839191.246370:0:5842:0:(import.c:65:import_set_state_nolock()) ffff91eb4042b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839191.246441:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875733747081472:12345-0@lo:38: Request processed in 175us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839191.246448:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1788839191.247417:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788839191.247449:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839191.247465:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839191.247476:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839191.247522:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788839191.247524:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788839191.247525:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839191.247527:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839191.247528:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839191.247530:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839191.247531:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839191.247533:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839191.247534:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839191.247536:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839191.247537:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839191.247541:0:6693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788839191.247543:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839191.247544:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788839191.247545:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839191.247546:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839191.247547:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839191.247548:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839191.247549:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839191.247550:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839191.247551:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839191.247552:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839191.247554:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839191.247581:0:6693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788839191.247597:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081600:0@lo:253: 00000100:00100000:2.0:1788839191.247657:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.247691:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.247839:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081600 00000100:00100000:0.0:1788839191.247845:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081600 00000100:00100000:0.0:1788839191.247889:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839191.247896:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:6693:x1875733747081600:12345-0@lo:253: 20000000:01000000:0.0:1788839191.247930:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788839191.247944:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788839191.248792:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eb0f8f9880 x1875733747081472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839191.248805:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839191.248813:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788839191.248820:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788839191.248826:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788839191.248830:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb373f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788839191.248836:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875733747081472:0@lo:38: 20000000:01000000:0.0:1788839191.282986:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788839191.283010:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788839191.283082:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788839191.283088:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788839191.283110:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.283130:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb14529200/0x4b63896d6363fa40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.283139:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.283196:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb14529200/0x4b63896d6363fa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.283212:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb14529200/0x4b63896d6363fa40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 13 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.283227:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875733747081728:0@lo:104: 00000100:00100000:1.0:1788839191.283297:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839191.283364:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1094a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839191.283979:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081728 00000100:00100000:0.0:1788839191.283987:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081728 00000100:00100000:0.0:1788839191.284039:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839191.284075:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5858:x1875733747081728:12345-0@lo:104: 00010000:00010000:0.0:1788839191.284089:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.284163:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839191.284169:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5858:x1875733747081728:12345-0@lo:104: Request processed in 122us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.284177:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788839191.284198:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839191.284204:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.284212:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839191.284216:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.284238:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839191.284246:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839191.284252:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839191.284281:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.284288:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839191.284306:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.284314:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fa39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839191.284330:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839191.284332:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839191.284333:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839191.284459:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747081856:0@lo:103: 00000100:00100000:2.0:1788839191.284499:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839191.284577:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875733747081728:0@lo:104: 00010000:00010000:2.0:1788839191.284598:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.284709:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081856 00000100:00100000:1.0:1788839191.284714:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081856 00010000:00010000:1.0:1788839191.284734:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb14529200/0x4b63896d6363fa40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 14 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839191.284764:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839191.284772:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2841848a-c637-485f-b8f2-edd7dddc336d+14:3311:x1875733747081856:12345-0@lo:103: 00010000:00010000:1.0:1788839191.284782:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839191.284787:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb14529200/0x4b63896d6363fa40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 14 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284798:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb14529200/0x4b63896d6363fa40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 14 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284811:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529200/0x4b63896d6363fa40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fa39 expref: 14 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284826:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284846:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839191.284858:0:6711:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001771366s 00010000:00010000:1.0:1788839191.284862:0:6711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284868:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284875:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284882:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284887:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839191.284891:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284898:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284911:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.284919:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839191.284964:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2841848a-c637-485f-b8f2-edd7dddc336d+13:3311:x1875733747081856:12345-0@lo:103: Request processed in 192us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839191.284971:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839191.285028:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747081856:0@lo:103: 00010000:00010000:1.0:1788839191.285044:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.285075:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839191.285081:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fae1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839191.291678:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:6693:x1875733747081600:12345-0@lo:253: Request processed in 43770us (44007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839191.291696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788839191.291820:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:6693:1875733747081600:0@lo:253: 10000000:01000000:2.0:1788839191.291837:0:6693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788839191.291840:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839191.291842:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788839191.291843:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839191.291845:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839191.291846:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839191.291848:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839191.291849:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839191.291851:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839191.291852:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839191.291854:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839191.291855:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788839191.291872:0:6693:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788839191.297707:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839191.297936:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788839191.298164:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839191.298340:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788839191.298885:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788839191.301228:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788839191.303486:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788839191.651288:0:6693:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788839191.651296:0:6693:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788839191.651329:0:6693:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788839191.651394:0:6693:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788839191.651409:0:6693:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788839191.651436:0:6693:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788839191.933746:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839192.957390:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839193.982896:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839195.005883:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839196.030686:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839196.479512:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747082240:0@lo:400: 00000100:00100000:2.0:1788839196.479590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839196.479645:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839196.479652:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747082112:0@lo:400: 00000100:00100000:2.0:1788839196.479676:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839196.479845:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747082240 00000100:00100000:0.0:1788839196.479854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747082240 00000100:00100000:0.0:1788839196.479914:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747082112 00000100:00100000:0.0:1788839196.479918:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747082112 00000100:00100000:0.0:1788839196.479936:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839196.479945:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747082240:12345-0@lo:400: 00000100:00100000:0.0:1788839196.479999:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747082240:12345-0@lo:400: Request processed in 56us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839196.480007:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839196.480024:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839196.480030:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747082112:12345-0@lo:400: 00000100:00100000:0.0:1788839196.480075:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747082112:12345-0@lo:400: Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839196.480082:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788839196.480122:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb3375c700 x1875733747082112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839196.480135:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747082112:0@lo:400: 00010000:00080000:0.0:1788839196.480149:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb3375e680 x1875733747082240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839196.480157:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747082240:0@lo:400: 00000100:00080000:2.0:1788839196.480289:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839196.480355:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839196.480366:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747081984:0@lo:400: 00000100:00100000:1.0:1788839196.480404:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839196.480519:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747081984 00000100:00100000:2.0:1788839196.480524:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747081984 00000100:00100000:2.0:1788839196.480554:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839196.480561:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:3311:x1875733747081984:12345-0@lo:400: 00000100:00100000:2.0:1788839196.480605:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:3311:x1875733747081984:12345-0@lo:400: Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839196.480611:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839196.480688:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747081984:0@lo:400: 00010000:00010000:2.0:1788839197.055385:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839198.080688:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788839198.226756:0:7060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788839199.102832:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788839199.549594:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788839199.549601:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb02d49000 from 21 10000000:01000000:0.0:1788839199.549606:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788839199.549644:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.549661:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.549671:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839199.549692:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747082368:0@lo:101: 00000100:00100000:0.0:1788839199.549759:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.549819:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.549840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747082368 00000100:00100000:0.0:1788839199.549846:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747082368 00000100:00100000:0.0:1788839199.549888:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788839199.549898:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747082368:12345-0@lo:101: 00010000:00010000:0.0:1788839199.549912:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839199.549924:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fae8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.549948:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.549958:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.549967:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb00031e00, rc 0) 00000100:00100000:0.0:1788839199.550003:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747082368:12345-0@lo:101: Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.550009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788839199.550072:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747082368:0@lo:101: 00010000:00010000:0.0:1788839199.550094:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.550101:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839199.550149:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747082496:0@lo:501: 00000100:00100000:0.0:1788839199.550174:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.550188:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.550202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747082496 00000100:00100000:0.0:1788839199.550206:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747082496 00000100:00100000:0.0:1788839199.550229:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788839199.550235:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747082496:12345-0@lo:501: 00000100:00100000:0.0:1788839199.551806:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747082496:12345-0@lo:501: Request processed in 1540us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.551817:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788839199.558498:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747082496:0@lo:501: 00000100:00100000:3.0:1788839199.558573:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747082624:0@lo:503: 00000100:00100000:3.0:1788839199.558653:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.558703:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839199.558732:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747082624 00000100:00100000:3.0:1788839199.558739:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747082624 00000100:00100000:3.0:1788839199.558798:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839199.558808:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747082624:12345-0@lo:503: 00000100:00100000:3.0:1788839199.559159:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747082624:12345-0@lo:503: Request processed in 352us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839199.559166:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839199.559211:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747082624:0@lo:503: 00000100:00100000:3.0:1788839199.559521:0:7126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7126:1875733747082752:0@lo:502: 00000100:00100000:3.0:1788839199.559561:0:7126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.559619:0:7126:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.559659:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747082752 00000100:00100000:0.0:1788839199.559664:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747082752 00000100:00100000:0.0:1788839199.559689:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839199.559696:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7126:x1875733747082752:12345-0@lo:502: 00000100:00100000:0.0:1788839199.560042:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7126:x1875733747082752:12345-0@lo:502: Request processed in 346us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.560240:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788839199.560316:0:7126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7126:1875733747082752:0@lo:502: 00000100:00100000:3.0:1788839199.560420:0:7126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7126:1875733747082880:0@lo:502: 00000100:00100000:3.0:1788839199.560458:0:7126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.560521:0:7126:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.560559:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747082880 00000100:00100000:0.0:1788839199.560563:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747082880 00000100:00100000:0.0:1788839199.560593:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788839199.560600:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:7126:x1875733747082880:12345-0@lo:502: 00000100:00100000:0.0:1788839199.560741:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:7126:x1875733747082880:12345-0@lo:502: Request processed in 141us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.560746:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788839199.560825:0:7126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7126:1875733747082880:0@lo:502: 00000040:00080000:3.0:1788839199.560844:0:7126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788839199.560978:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788839199.561000:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788839199.561010:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561020:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839199.561030:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788839199.561033:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eb02d49000 from 4 10000000:01000000:0.0:1788839199.561035:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839199.561429:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561438:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561447:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839199.561460:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083008:0@lo:101: 00000100:00100000:0.0:1788839199.561491:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.561513:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.561525:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083008 00000100:00100000:0.0:1788839199.561529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083008 00000100:00100000:0.0:1788839199.561547:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788839199.561554:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747083008:12345-0@lo:101: 00010000:00010000:0.0:1788839199.561568:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839199.561578:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363faf6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561596:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561604:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561612:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb00030800, rc 0) 00000100:00100000:0.0:1788839199.561635:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747083008:12345-0@lo:101: Request processed in 81us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.561641:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788839199.561666:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083008:0@lo:101: 00010000:00010000:0.0:1788839199.561676:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561684:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839199.561721:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083136:0@lo:256: 00000100:00100000:0.0:1788839199.561748:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.561761:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.561772:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083136 00000100:00100000:0.0:1788839199.561788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083136 00000100:00100000:0.0:1788839199.561808:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788839199.561813:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747083136:12345-0@lo:256: 20000000:01000000:0.0:1788839199.561832:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839199.561845:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839199.561847:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788839199.561911:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747083136:12345-0@lo:256: Request processed in 96us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.561917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788839199.561945:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083136:0@lo:256: 10000000:01000000:0.0:1788839199.561979:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839199.561984:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.561991:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839199.561998:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788839199.562000:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788839199.562002:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788839199.562015:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.562021:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.562027:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839199.562037:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083264:0@lo:101: 00000100:00100000:0.0:1788839199.562080:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.562091:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.562106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083264 00000100:00100000:0.0:1788839199.562109:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083264 00000100:00100000:0.0:1788839199.562126:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839199.562131:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747083264:12345-0@lo:101: 00010000:00010000:0.0:1788839199.562138:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839199.562146:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fb04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.562158:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.562166:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.562172:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb00030400, rc 0) 00000100:00100000:0.0:1788839199.562197:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747083264:12345-0@lo:101: Request processed in 65us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.562203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839199.562229:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083264:0@lo:101: 00010000:00010000:0.0:1788839199.562239:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839199.562246:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839199.562283:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083392:0@lo:501: 00000100:00100000:0.0:1788839199.562306:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.562317:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.562327:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083392 00000100:00100000:0.0:1788839199.562336:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083392 00000100:00100000:0.0:1788839199.562355:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788839199.562480:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747083392:12345-0@lo:501: 00000100:00100000:0.0:1788839199.562750:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747083392:12345-0@lo:501: Request processed in 266us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.562758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788839199.562831:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083392:0@lo:501: 00000100:00100000:3.0:1788839199.562856:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083520:0@lo:503: 00000100:00100000:3.0:1788839199.562891:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.562967:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.563002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083520 00000100:00100000:0.0:1788839199.563006:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083520 00000100:00100000:0.0:1788839199.563072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788839199.563079:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747083520:12345-0@lo:503: 00000100:00100000:0.0:1788839199.563339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747083520:12345-0@lo:503: Request processed in 260us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.563345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788839199.565787:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747083520:0@lo:503: 00000100:00100000:0.0:1788839199.566023:0:7127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7127:1875733747083648:0@lo:502: 00000100:00100000:0.0:1788839199.566117:0:7127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.566148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083648 00000100:00100000:0.0:1788839199.566154:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083648 00000100:00100000:0.0:1788839199.566194:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839199.566204:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:7127:x1875733747083648:12345-0@lo:502: 00000100:00100000:0.0:1788839199.566567:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:7127:x1875733747083648:12345-0@lo:502: Request processed in 363us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.566575:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839199.566624:0:7127:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.566637:0:7127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7127:1875733747083648:0@lo:502: 00000020:01000000:0.0:1788839199.566659:0:7127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788839199.566672:0:7127:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788839199.566679:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839199.566682:0:7127:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788839199.566689:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788839199.566693:0:7127:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:0.0:1788839199.566715:0:7127:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788839199.566718:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788839199.566734:0:7127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91eb0f9019b8) 00000020:00000080:0.0:1788839199.566752:0:7127:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788839199.566757:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788839199.566840:0:7127:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788839199.566845:0:7127:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788839199.566851:0:7127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d6363fb19 00010000:00080000:0.0:1788839199.566889:0:7127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb37138000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1788839199.567114:0:7127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788839199.596658:0:7127:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788839199.596681:0:7127:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788839199.597243:0:7127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839199.598588:0:7127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839199.598648:0:7127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788839199.598710:0:7127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788839199.607637:0:7129:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839199.607648:0:7129:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788839199.611404:0:7127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839199.611420:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788839199.611453:0:7127:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788839199.611471:0:7127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d6363fb20 00000100:00080000:1.0:1788839199.611482:0:7127:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839199.611488:0:7127:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eb37138000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:1.0:1788839199.611523:0:7127:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb1e5c5c00 x1875733747083776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839199.611552:0:7127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788839199.611608:0:7127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839199.611612:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839199.611614:0:7127:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788839199.611617:0:7127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839199.611620:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839199.611622:0:7127:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788839199.611634:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788839199.611636:0:7127:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788839199.611660:0:7127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7127:1875733747083904:0@lo:502: 00000100:00100000:1.0:1788839199.611733:0:7127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839199.611768:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083904 00000100:00100000:1.0:1788839199.611784:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083904 00000100:00100000:1.0:1788839199.611820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788839199.611827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:7127:x1875733747083904:12345-0@lo:502: 00000100:00100000:1.0:1788839199.612031:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:7127:x1875733747083904:12345-0@lo:502: Request processed in 202us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839199.612038:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788839199.612126:0:7127:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02efc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839199.612147:0:7127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:7127:1875733747083904:0@lo:502: 00000020:01000000:1.0:1788839199.612171:0:7127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839199.612176:0:7127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839199.612177:0:7127:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788839199.612181:0:7127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788839199.612241:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788839199.612254:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788839199.612264:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612274:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839199.612284:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788839199.612286:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eb09e08000 from 1 10000000:01000000:1.0:1788839199.612289:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788839199.612309:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612322:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612331:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839199.612341:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747084032:0@lo:101: 00000100:00100000:1.0:1788839199.612370:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839199.612386:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02efc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839199.612401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084032 00000100:00100000:1.0:1788839199.612405:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084032 00000100:00100000:1.0:1788839199.612424:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788839199.612431:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747084032:12345-0@lo:101: 00010000:00010000:1.0:1788839199.612440:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839199.612451:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fb27 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612471:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612480:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612488:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:1.0:1788839199.612512:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747084032:12345-0@lo:101: Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839199.612518:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788839199.612546:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747084032:0@lo:101: 00010000:00010000:1.0:1788839199.612562:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612570:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839199.612602:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747084160:0@lo:501: 00000100:00100000:1.0:1788839199.612623:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839199.612634:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02efc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839199.612644:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084160 00000100:00100000:1.0:1788839199.612648:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084160 00000100:00100000:1.0:1788839199.612664:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788839199.612669:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747084160:12345-0@lo:501: 00000100:00100000:1.0:1788839199.612863:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747084160:12345-0@lo:501: Request processed in 193us (239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839199.612868:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788839199.612897:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747084160:0@lo:501: 10000000:01000000:1.0:1788839199.612913:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788839199.612918:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839199.612925:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839199.613031:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747083776:0@lo:8: 00000100:00100000:3.0:1788839199.613084:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.613454:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747084416:0@lo:400: 00000100:00100000:3.0:1788839199.613486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.613514:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839199.613520:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747084288:0@lo:400: 00000100:00100000:3.0:1788839199.613545:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.613574:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084416 00000100:00100000:3.0:1788839199.613578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084416 00000100:00100000:3.0:1788839199.613612:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084288 00000100:00100000:3.0:1788839199.613615:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084288 00000100:00100000:3.0:1788839199.613628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839199.613634:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747084416:12345-0@lo:400: 00000100:00100000:3.0:1788839199.613674:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747084416:12345-0@lo:400: Request processed in 39us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839199.613680:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839199.613695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839199.613701:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747084288:12345-0@lo:400: 00000100:00100000:3.0:1788839199.613725:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747084288:12345-0@lo:400: Request processed in 24us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839199.613730:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788839199.613786:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8f9500 x1875733747084288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839199.613797:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747084288:0@lo:400: 00010000:00080000:3.0:1788839199.613808:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8f8a80 x1875733747084416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839199.613825:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747084416:0@lo:400: 00000100:00080000:2.0:1788839199.614026:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839199.614187:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747083776 00000100:00100000:2.0:1788839199.614192:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747083776 00000100:00100000:2.0:1788839199.614220:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839199.614226:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875733747083776:12345-0@lo:8: 00010000:00080000:2.0:1788839199.614250:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1788839199.614276:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d6363fb35 00002000:00100000:2.0:1788839199.614329:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91eb36e87000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788839199.614334:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788839199.614338:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788839199.614444:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788839199.614579:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788839199.614602:0:6696:0:(import.c:65:import_set_state_nolock()) ffff91eb36e80000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839199.614656:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875733747083776:12345-0@lo:8: Request processed in 428us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839199.614662:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788839199.614714:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb1e5c5c00 x1875733747083776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839199.614724:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839199.614731:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788839199.614738:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788839199.614743:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788839199.614745:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb37138000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788839199.614754:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788839199.614758:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747083776:0@lo:8: 00000004:00080000:3.0:1788839199.614838:0:7129:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788839199.614933:0:7129:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 182305881887ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788839199.677748:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788839199.723282:0:7132:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788839199.723336:0:7132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747084672:0@lo:7: 00000100:00100000:0.0:1788839199.723424:0:7132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.723485:0:7132:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb03865cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839199.723519:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747084544:0@lo:13: 00000100:00100000:0.0:1788839199.723545:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839199.723587:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084672 00000100:00100000:0.0:1788839199.723594:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084672 00000100:00100000:0.0:1788839199.723646:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839199.723656:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7132:x1875733747084672:12345-0@lo:7: 00000100:00080000:2.0:1788839199.728525:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839199.728565:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084544 00000100:00100000:2.0:1788839199.728575:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084544 00000100:00100000:2.0:1788839199.728627:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839199.728636:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747084544:12345-0@lo:13: 00002000:00000024:2.0:1788839199.728669:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788839199.728752:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747084544:12345-0@lo:13: Request processed in 117us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839199.728791:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788839199.730168:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8fbb80 x1875733747084544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839199.730192:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747084544:0@lo:13: 00002000:00080000:0.0:1788839199.746709:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788839199.746718:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788839199.747633:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7132:x1875733747084672:12345-0@lo:7: Request processed in 23972us (24202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839199.747645:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788839199.753719:0:7132:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8faa00 x1875733747084672/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839215 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839199.753739:0:7132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747084672:0@lo:7: 00000004:00080000:3.0:1788839199.754473:0:7132:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788839199.754531:0:7132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747084800:0@lo:5: 00000100:00100000:3.0:1788839199.754599:0:7132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.754745:0:7132:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839199.760574:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084800 00000100:00100000:1.0:1788839199.760590:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084800 00000100:00100000:1.0:1788839199.760638:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839199.760648:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7132:x1875733747084800:12345-0@lo:5: 00002000:00080000:1.0:1788839199.760693:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788839199.760697:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788839199.761910:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7132:x1875733747084800:12345-0@lo:5: Request processed in 1260us (7306us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788839199.761920:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788839199.762206:0:7132:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb33768e00 x1875733747084800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839215 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839199.762223:0:7132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747084800:0@lo:5: 00000004:00080000:3.0:1788839199.762237:0:7132:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788839199.762276:0:7132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747084928:0@lo:700: 00000100:00100000:3.0:1788839199.762328:0:7132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839199.762376:0:7132:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839199.762547:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747084928 00000100:00100000:1.0:1788839199.762553:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747084928 00000100:00100000:1.0:1788839199.762589:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839199.762596:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7132:x1875733747084928:12345-0@lo:700: 00000100:00100000:1.0:1788839199.762625:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1875733747085056:0@lo:700: 00000100:00100000:1.0:1788839199.762652:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839199.762738:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02efc000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839199.764728:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085056 00000100:00100000:3.0:1788839199.764741:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085056 00000100:00100000:3.0:1788839199.766145:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839199.766161:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1875733747085056:12345-0@lo:700: 40000000:02000000:3.0:1788839199.899283:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788839199.905837:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1875733747085056:12345-0@lo:700: Request processed in 139664us (143165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839199.905861:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788839199.908696:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb1e5c7100 x1875733747085056/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788839215 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839199.908716:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1875733747085056:0@lo:700: 40000000:02000000:0.0:1788839199.908731:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788839200.046202:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788839200.046222:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788839200.046327:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7132:x1875733747084928:12345-0@lo:700: Request processed in 283727us (284008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839200.046338:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788839200.046398:0:7132:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb33769880 x1875733747084928/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788839215 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839200.046410:0:7132:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788839200.046429:0:7132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747084928:0@lo:700: 00000004:02000040:1.0:1788839200.080622:0:7132:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788839200.087871:0:7132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747085184:0@lo:5: 00000100:00100000:0.0:1788839200.088069:0:7132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839200.088129:0:7132:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0382b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839200.089646:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085184 00000100:00100000:2.0:1788839200.089658:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085184 00000100:00100000:2.0:1788839200.089721:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839200.089734:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7132:x1875733747085184:12345-0@lo:5: 00002000:00080000:3.0:1788839200.102894:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788839200.103584:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788839200.107198:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7132:x1875733747085184:12345-0@lo:5: Request processed in 17461us (19145us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788839200.107211:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788839200.107386:0:7132:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8fbb80 x1875733747085184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839216 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839200.107404:0:7132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7132:1875733747085184:0@lo:5: 00000004:00080000:0.0:1788839200.107420:0:7132:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788839200.125301:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839201.149587:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839202.173215:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839203.203765:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839203.670546:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788839204.222399:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839204.673887:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747085312:0@lo:400: 00000100:00100000:0.0:1788839204.673974:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839204.674031:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839204.674038:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747085696:0@lo:400: 00000100:00100000:0.0:1788839204.674082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839204.674111:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747085440:0@lo:400: 00000100:00100000:0.0:1788839204.674133:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839204.674156:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839204.674161:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747085568:0@lo:400: 00000100:00100000:0.0:1788839204.674180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839204.674207:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085312 00000100:00100000:0.0:1788839204.674213:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085312 00000100:00100000:0.0:1788839204.674253:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839204.674261:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:3314:x1875733747085312:12345-0@lo:400: 00000100:00100000:0.0:1788839204.674783:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:3314:x1875733747085312:12345-0@lo:400: Request processed in 521us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839204.674792:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839204.674825:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085696 00000100:00100000:0.0:1788839204.674828:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085696 00000100:00100000:0.0:1788839204.674863:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839204.674870:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747085696:12345-0@lo:400: 00000100:00100000:0.0:1788839204.674898:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747085696:12345-0@lo:400: Request processed in 29us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839204.674904:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839204.674979:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085440 00000100:00100000:0.0:1788839204.674983:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085440 00000100:00100000:0.0:1788839204.675003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085568 00000100:00100000:0.0:1788839204.675006:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085568 00000100:00100000:0.0:1788839204.675020:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839204.675025:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747085440:12345-0@lo:400: 00000100:00100000:0.0:1788839204.675072:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747085440:12345-0@lo:400: Request processed in 46us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839204.675078:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839204.675088:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839204.675093:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747085568:12345-0@lo:400: 00000100:00100000:0.0:1788839204.675124:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747085568:12345-0@lo:400: Request processed in 31us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839204.675130:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788839204.675150:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839204.675154:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788839204.675183:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8f9180 x1875733747085568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839204.675197:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747085568:0@lo:400: 00010000:00080000:0.0:1788839204.675209:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8f8e00 x1875733747085440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839204.675217:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747085440:0@lo:400: 00010000:00080000:0.0:1788839204.675242:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb0f8fad80 x1875733747085696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839204.675250:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788839204.675257:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747085696:0@lo:400: 00000100:00100000:0.0:1788839204.675661:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747085312:0@lo:400: 00000100:00100000:0.0:1788839205.186507:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747085824:0@lo:13: 00000100:00100000:0.0:1788839205.186585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839205.187481:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085824 00000100:00100000:1.0:1788839205.187490:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085824 00000100:00100000:1.0:1788839205.187539:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839205.187548:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747085824:12345-0@lo:13: 00002000:00000024:1.0:1788839205.187593:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839205.187650:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747085824:12345-0@lo:13: Request processed in 103us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839205.187657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788839205.187715:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb1e5c4a80 x1875733747085824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839205.187736:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747085824:0@lo:13: 00010000:00010000:0.0:1788839205.245351:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839206.276587:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839207.293631:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839208.317833:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839209.347696:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839209.789490:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747086336:0@lo:400: 00000100:00100000:1.0:1788839209.789563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839209.789634:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839209.789641:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747086208:0@lo:400: 00000100:00100000:1.0:1788839209.789668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839209.789740:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747086080:0@lo:400: 00000100:00100000:0.0:1788839209.789772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839209.789800:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839209.789805:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747085952:0@lo:400: 00000100:00100000:0.0:1788839209.789853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839209.789894:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086208 00000100:00100000:0.0:1788839209.789901:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086208 00000100:00100000:0.0:1788839209.789950:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086080 00000100:00100000:0.0:1788839209.789953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086080 00000100:00100000:0.0:1788839209.789972:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839209.789982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747086208:12345-0@lo:400: 00000100:00100000:0.0:1788839209.790039:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747086208:12345-0@lo:400: Request processed in 58us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839209.790046:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839209.790088:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839209.790096:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747086080:12345-0@lo:400: 00000100:00100000:0.0:1788839209.790128:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747086080:12345-0@lo:400: Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839209.790134:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839209.790153:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747085952 00000100:00100000:0.0:1788839209.790157:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747085952 00000100:00100000:0.0:1788839209.790182:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839209.790189:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:3312:x1875733747085952:12345-0@lo:400: 00000100:00100000:0.0:1788839209.790219:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:3312:x1875733747085952:12345-0@lo:400: Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839209.790225:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788839209.790249:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839209.790275:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747085952:0@lo:400: 00010000:00080000:0.0:1788839209.790290:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb1e5c7b80 x1875733747086080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839209.790301:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747086080:0@lo:400: 00010000:00080000:0.0:1788839209.790345:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb1e5c6a00 x1875733747086208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839209.790355:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747086208:0@lo:400: 00000100:00100000:3.0:1788839209.793395:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086336 00000100:00100000:3.0:1788839209.793410:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086336 00000100:00100000:3.0:1788839209.793494:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839209.793505:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747086336:12345-0@lo:400: 00000100:00100000:3.0:1788839209.793610:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747086336:12345-0@lo:400: Request processed in 108us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839209.793618:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788839209.793725:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788839209.793762:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb1e5c4700 x1875733747086336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839209.793777:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747086336:0@lo:400: 00000100:00100000:2.0:1788839210.302135:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747086464:0@lo:13: 00000100:00100000:2.0:1788839210.302217:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.302296:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086464 00000100:00100000:2.0:1788839210.302305:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086464 00000100:00100000:2.0:1788839210.302357:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839210.302367:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747086464:12345-0@lo:13: 00002000:00000024:2.0:1788839210.302404:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839210.302448:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747086464:12345-0@lo:13: Request processed in 82us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.302455:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788839210.302599:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb3375ed80 x1875733747086464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839210.302619:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747086464:0@lo:13: 00010000:00010000:2.0:1788839210.365388:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788839210.589514:0:7634:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788839210.589519:0:7634:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788839210.589681:0:7634:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eb02e9b800 00000020:01000004:2.0:1788839210.589697:0:7634:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788839210.589712:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788839210.589737:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91eb3360b370) 00000020:00000080:2.0:1788839210.589755:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788839210.604404:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788839210.604811:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788839210.626423:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788839210.631638:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788839210.631740:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788839210.631800:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788839210.631829:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788839210.632360:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788839210.632374:0:7634:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839210.632386:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b63896d6363fb43 00000020:01000004:3.0:1788839210.632395:0:7634:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788839210.632415:0:7634:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788839210.632418:0:7634:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788839210.632423:0:7634:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788839210.632443:0:7634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788839210.632447:0:7634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788839210.650554:0:7634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839210.650739:0:7634:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.109@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788839210.650743:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839210.650746:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839210.650747:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839210.650749:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839210.650750:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839210.650752:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839210.650753:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839210.650755:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788839210.650756:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788839210.650758:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839210.650759:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839210.650763:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788839210.650766:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839210.650767:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839210.650768:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839210.650769:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839210.650770:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839210.650772:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839210.650773:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839210.650774:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788839210.650775:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788839210.650776:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839210.650778:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839210.650804:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788839210.650822:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747086592:0@lo:253: 00000100:00100000:3.0:1788839210.650894:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.651011:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.651288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086592 00000100:00100000:0.0:1788839210.651296:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086592 00000100:00100000:0.0:1788839210.651393:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839210.651403:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+16:7634:x1875733747086592:12345-0@lo:253: 20000000:01000000:0.0:1788839210.651432:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788839210.651437:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788839210.651442:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788839210.651446:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788839210.652861:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839210.653107:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788839210.653121:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788839210.653157:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788839210.653166:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788839210.653195:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788839210.653242:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788839210.653869:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788839210.653891:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:0.0:1788839210.653894:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:0.0:1788839210.653926:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788839210.653934:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788839210.653988:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788839210.653996:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:0.0:1788839210.654025:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788839210.654033:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788839210.654138:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788839210.654261:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788839210.655356:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788839210.655381:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:0.0:1788839210.655383:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:0.0:1788839210.655416:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788839210.655424:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788839210.655452:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788839210.655459:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:0.0:1788839210.655487:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788839210.655495:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788839210.655538:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788839210.655754:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788839210.655774:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788839210.655776:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788839210.655780:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788839210.655792:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788839210.655794:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788839210.655828:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788839210.655831:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788839210.656887:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788839210.656971:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788839210.657003:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788839210.657387:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788839210.657428:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788839210.657480:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788839210.657492:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788839210.657495:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788839210.657993:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788839210.658401:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788839210.658441:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788839210.658496:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788839210.658516:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788839210.658518:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788839210.659328:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788839210.659386:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788839210.659441:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788839210.659855:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788839210.659895:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788839210.659956:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788839210.659968:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788839210.659970:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788839210.660880:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788839210.660944:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788839210.660998:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788839210.661484:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788839210.661528:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788839210.661644:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788839210.661736:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788839210.661739:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788839210.661749:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788839210.661769:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661786:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661794:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fabe expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661801:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661808:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661815:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661822:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661872:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.661887:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 16 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.661901:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747086720:0@lo:104: 00000100:00100000:0.0:1788839210.661974:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839210.662114:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.662122:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 16 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.662130:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747086848:0@lo:104: 00010000:00010000:0.0:1788839210.662157:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.662176:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 16 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.662184:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747086976:0@lo:104: 00010000:00010000:0.0:1788839210.662209:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fabe expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.662217:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fabe expref: 16 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.662226:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747087104:0@lo:104: 00010000:00010000:0.0:1788839210.662260:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.662268:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 16 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.662276:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747087232:0@lo:104: 00000100:00100000:0.0:1788839210.662295:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06444e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839210.663839:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788839210.663882:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.664017:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.664298:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.664336:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086720 00000100:00100000:2.0:1788839210.664346:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086720 00000100:00100000:2.0:1788839210.664387:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086848 00000100:00100000:2.0:1788839210.664390:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086848 00000100:00100000:2.0:1788839210.664401:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747086976 00000100:00100000:2.0:1788839210.664404:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747086976 00000100:00100000:2.0:1788839210.664417:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839210.664427:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+5:5838:x1875733747086720:12345-0@lo:104: 00010000:00010000:2.0:1788839210.664444:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.664587:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839210.664595:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+5:5838:x1875733747086720:12345-0@lo:104: Request processed in 170us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.664602:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839210.664643:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839210.664650:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+4:5838:x1875733747086848:12345-0@lo:104: 00010000:00010000:3.0:1788839210.664737:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839210.664757:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.664765:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f000 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839210.664770:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.664779:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839210.664787:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839210.664794:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839210.664833:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.664840:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839210.664859:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.664866:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f000/0x4b63896d6363fb27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.664878:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839210.664880:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839210.664882:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839210.664903:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747087360:0@lo:103: 00000100:00100000:3.0:1788839210.664938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.664987:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747087360 00000100:00100000:3.0:1788839210.664991:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747087360 00010000:00010000:3.0:1788839210.665018:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 17 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.665042:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839210.665073:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+17:3312:x1875733747087360:12345-0@lo:103: 00010000:00010000:3.0:1788839210.665085:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839210.665091:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 17 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665102:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 17 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665121:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839210.665152:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+17:3312:x1875733747087360:12345-0@lo:103: Request processed in 103us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.665170:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839210.665208:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747087360:0@lo:103: 00010000:00010000:2.0:1788839210.665325:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.665368:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839210.665380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+4:5838:x1875733747086848:12345-0@lo:104: Request processed in 731us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.665387:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839210.665403:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839210.665410:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5838:x1875733747086976:12345-0@lo:104: 00010000:00010000:2.0:1788839210.665418:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.665450:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839210.665455:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5838:x1875733747086976:12345-0@lo:104: Request processed in 47us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.665461:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788839210.665509:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839210.665515:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665522:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb00031c00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839210.665526:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665534:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839210.665541:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839210.665553:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839210.665591:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665597:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839210.665616:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665623:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb00031c00/0x4b63896d6363fb04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665635:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839210.665638:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665644:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb00031800 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839210.665646:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665665:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839210.665672:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839210.665677:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839210.665691:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665696:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839210.665709:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665716:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb00031800/0x4b63896d6363fae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363faef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665725:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839210.665727:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839210.665729:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839210.665740:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747087488:0@lo:103: 00000100:00100000:3.0:1788839210.665769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.665799:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839210.665805:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747087616:0@lo:103: 00000100:00100000:3.0:1788839210.665827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.665857:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747087488 00000100:00100000:3.0:1788839210.665862:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747087488 00010000:00010000:3.0:1788839210.665877:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 17 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.665895:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747087616 00000100:00100000:3.0:1788839210.665897:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747087616 00010000:00010000:3.0:1788839210.665925:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 18 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.665944:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839210.665951:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+18:3313:x1875733747087488:12345-0@lo:103: 00010000:00010000:3.0:1788839210.665960:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839210.665965:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 18 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665983:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 18 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.665994:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839210.666022:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+18:3313:x1875733747087488:12345-0@lo:103: Request processed in 72us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.666030:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839210.666044:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839210.666082:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+17:3313:x1875733747087616:12345-0@lo:103: 00010000:00010000:3.0:1788839210.666090:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839210.666094:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 17 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.666104:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 17 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.666113:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839210.666134:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+17:3313:x1875733747087616:12345-0@lo:103: Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.666140:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839210.666186:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747087616:0@lo:103: 00000100:00100000:3.0:1788839210.666194:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747087488:0@lo:103: 00010000:00010000:3.0:1788839210.666210:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839210.666513:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fb2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fb27 expref: 16 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.666525:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747086720:0@lo:104: 00010000:00010000:0.0:1788839210.666535:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb00030400/0x4b63896d6363fb0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fb04 expref: 15 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.666546:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747086848:0@lo:104: 00010000:00010000:0.0:1788839210.666564:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb00031e00/0x4b63896d6363faef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fae8 expref: 14 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839210.666581:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747086976:0@lo:104: 00000100:00100000:1.0:1788839210.666779:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.666850:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747087104 00000100:00100000:2.0:1788839210.666856:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747087104 00000100:00100000:2.0:1788839210.666882:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747087232 00000100:00100000:2.0:1788839210.666885:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747087232 00000100:00100000:2.0:1788839210.666897:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839210.666905:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+4:5838:x1875733747087104:12345-0@lo:104: 00010000:00010000:2.0:1788839210.666916:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.666974:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839210.666980:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+4:5838:x1875733747087104:12345-0@lo:104: Request processed in 77us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.666987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839210.667001:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839210.667007:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5838:x1875733747087232:12345-0@lo:104: 00010000:00010000:2.0:1788839210.667015:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.667077:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839210.667083:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5838:x1875733747087232:12345-0@lo:104: Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.667090:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839210.667154:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747087104:0@lo:104: 00000100:00100000:0.0:1788839210.667229:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1875733747087232:0@lo:104: 00010000:00010000:0.0:1788839210.667252:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667316:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839210.667322:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667341:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965800 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839210.667345:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667352:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839210.667359:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839210.667365:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839210.667400:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667406:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788839210.667448:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747087744:0@lo:103: 00000100:00100000:0.0:1788839210.667479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839210.667763:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667771:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20965800/0x4b63896d6363fabe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fac5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667784:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839210.667787:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667793:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839210.667795:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667814:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839210.667821:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839210.667826:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839210.667847:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667854:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839210.667863:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667870:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fa94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa9b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.667884:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839210.667886:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839210.667887:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839210.667899:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839210.667906:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747087872:0@lo:103: 00000100:00100000:3.0:1788839210.667933:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.667961:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747087744 00000100:00100000:3.0:1788839210.667966:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747087744 00010000:00010000:3.0:1788839210.667983:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fabe expref: 14 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.668002:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747087872 00000100:00100000:3.0:1788839210.668005:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747087872 00010000:00010000:3.0:1788839210.668025:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 15 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.668044:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839210.668077:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+15:3311:x1875733747087744:12345-0@lo:103: 00010000:00010000:3.0:1788839210.668090:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839210.668095:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fabe expref: 15 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668106:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fabe expref: 15 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668119:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529000/0x4b63896d6363fac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fabe expref: 15 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668132:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839210.668829:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+14:3311:x1875733747087744:12345-0@lo:103: Request processed in 773us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.668837:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839210.668856:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839210.668864:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+13:3311:x1875733747087872:12345-0@lo:103: 00010000:00010000:3.0:1788839210.668873:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839210.668877:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 13 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668887:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 13 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668898:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20964a00/0x4b63896d6363fa9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fa94 expref: 13 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668922:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668931:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668947:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668954:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668961:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668968:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668974:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839210.668979:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.668986:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.669190:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839210.669374:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.669382:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788839210.669390:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788839210.671188:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747087744:0@lo:103: 00010000:00010000:3.0:1788839210.671381:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.671396:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.671440:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839210.671553:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+12:3311:x1875733747087872:12345-0@lo:103: Request processed in 2690us (3617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.671625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839210.671758:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747087872:0@lo:103: 00000100:00100000:0.0:1788839210.713178:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+11:7634:x1875733747086592:12345-0@lo:253: Request processed in 61759us (62265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839210.713194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788839210.713307:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747086592:0@lo:253: 10000000:01000000:3.0:1788839210.713323:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788839210.713327:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839210.713329:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839210.713330:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839210.713331:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788839210.713333:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839210.713335:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839210.713336:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839210.713338:0:7634:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788839210.713339:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839210.713341:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839210.713360:0:7634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eb02e9b800 from lustre-OST0001 10000000:01000000:3.0:1788839210.713384:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788839210.713387:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788839210.713395:0:7634:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eb09e08000 local copy 10000000:01000000:3.0:1788839210.713399:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839210.713434:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.713446:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.713455:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.713473:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088000:0@lo:101: 00000100:00100000:3.0:1788839210.713522:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.713568:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.713786:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088000 00000100:00100000:0.0:1788839210.713792:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088000 00000100:00100000:0.0:1788839210.713825:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839210.713834:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+11:7634:x1875733747088000:12345-0@lo:101: 00010000:00010000:0.0:1788839210.713845:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839210.713858:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fb51 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.713880:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fb51 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.713891:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb51 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.713901:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6a00, rc 0) 00000100:00100000:0.0:1788839210.713940:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088000:12345-0@lo:101: Request processed in 107us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839210.713946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788839210.714018:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088000:0@lo:101: 00010000:00010000:3.0:1788839210.714030:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.714039:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.714173:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088128:0@lo:501: 00000100:00100000:3.0:1788839210.714201:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.714219:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.714314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088128 00000100:00100000:0.0:1788839210.714318:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088128 00000100:00100000:0.0:1788839210.714359:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839210.714366:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088128:12345-0@lo:501: 00000100:00100000:0.0:1788839210.714550:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088128:12345-0@lo:501: Request processed in 184us (348us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839210.714569:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788839210.714804:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088128:0@lo:501: 10000000:01000000:3.0:1788839210.714817:0:7634:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788839210.714843:0:7634:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788839210.714849:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.714857:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.714865:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.714888:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788839210.714907:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eb02e9b800 10000000:01000000:3.0:1788839210.714912:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788839210.714917:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788839210.714925:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839210.714930:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788839210.714933:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788839210.714950:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.714957:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.714965:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839210.714977:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088256:0@lo:101: 00000100:00100000:3.0:1788839210.715003:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.715025:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839210.715079:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088256 00000100:00100000:1.0:1788839210.715084:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088256 00000100:00100000:1.0:1788839210.715116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788839210.715124:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088256:12345-0@lo:101: 00010000:00010000:1.0:1788839210.715132:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839210.715142:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fb5f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.715169:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.715188:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.715197:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e200, rc 0) 00000100:00100000:1.0:1788839210.715231:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747088256:12345-0@lo:101: Request processed in 108us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.715237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788839210.715270:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088256:0@lo:101: 00010000:00010000:1.0:1788839210.715281:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.715289:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839210.715345:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088384:0@lo:501: 00000100:00100000:1.0:1788839210.715370:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.715388:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839210.715497:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088384 00000100:00100000:3.0:1788839210.715501:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088384 00000100:00100000:3.0:1788839210.715530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788839210.715537:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747088384:12345-0@lo:501: 00000100:00100000:3.0:1788839210.715847:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747088384:12345-0@lo:501: Request processed in 310us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.715855:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:0.0:1788839210.715926:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839210.715933:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.715941:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529000 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839210.715946:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.715956:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839210.715964:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839210.715971:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839210.715990:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.715997:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839210.716017:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.716025:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fb51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b63896d6363fb58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.716086:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839210.716088:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839210.716090:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839210.716145:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088384:0@lo:501: 00000100:00100000:1.0:1788839210.716245:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088640:0@lo:503: 00000100:00100000:1.0:1788839210.716283:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.716314:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839210.716329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088640 00000100:00100000:1.0:1788839210.716333:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088640 00000100:00100000:1.0:1788839210.716365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839210.716371:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747088640:12345-0@lo:503: 00000100:00100000:1.0:1788839210.716524:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747088640:12345-0@lo:503: Request processed in 153us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.716537:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839210.716598:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088640:0@lo:503: 00000100:00100000:3.0:1788839210.716751:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747088512:0@lo:103: 00000100:00100000:3.0:1788839210.716781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.717244:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088512 00000100:00100000:2.0:1788839210.717249:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088512 00000100:00100000:2.0:1788839210.717292:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839210.717300:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+13:3313:x1875733747088512:12345-0@lo:103: 00010000:00010000:2.0:1788839210.717311:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839210.717329:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fb51 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.717344:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839210.717387:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+12:3313:x1875733747088512:12345-0@lo:103: Request processed in 89us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.717394:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839210.717450:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747088512:0@lo:103: 00000040:00080000:1.0:1788839210.717864:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839210.717931:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088768:0@lo:502: 00000100:00100000:1.0:1788839210.717976:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.719192:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839210.719302:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088768 00000100:00100000:3.0:1788839210.719310:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088768 00000100:00100000:3.0:1788839210.719388:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788839210.719398:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088768:12345-0@lo:502: 00000100:00100000:3.0:1788839210.719635:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088768:12345-0@lo:502: Request processed in 238us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.719649:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839210.719800:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088768:0@lo:502: 00000040:00080000:1.0:1788839210.720117:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788839210.720183:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788839210.720219:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788839210.720265:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788839210.720300:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788839210.720330:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788839210.720361:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088896:0@lo:502: 00000100:00100000:1.0:1788839210.720405:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.720850:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.720918:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747088896 00000100:00100000:0.0:1788839210.720924:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747088896 00000100:00100000:0.0:1788839210.720955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788839210.720963:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088896:12345-0@lo:502: 00000100:00100000:0.0:1788839210.721148:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747088896:12345-0@lo:502: Request processed in 184us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839210.721165:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788839210.721301:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747088896:0@lo:502: 00000040:00080000:1.0:1788839210.721392:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788839210.721402:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788839210.722000:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839210.722008:0:7641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788839210.722014:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839210.722017:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788839210.722021:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839210.722043:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91eb3772cd28) 00000020:00000080:1.0:1788839210.722094:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788839210.722100:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788839210.722244:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eb02e9b800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788839210.722253:0:7641:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788839210.722261:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b63896d6363fb74 00010000:00010000:1.0:1788839210.727328:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788839210.727881:0:7641:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788839210.730792:0:7641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788839210.731119:0:7641:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788839210.735350:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788839210.736006:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788839210.737723:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788839210.737734:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839210.737740:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839210.737742:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788839210.737746:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839210.737750:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839210.737751:0:7641:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788839210.737755:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788839210.737757:0:7641:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788839210.737806:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839210.737809:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839210.737810:0:7641:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788839210.737813:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788839210.738040:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788839210.738099:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788839210.738117:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.738130:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839210.738139:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02e9b800 from 1 10000000:01000000:1.0:1788839210.738141:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839210.738189:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.738199:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.738210:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839210.738233:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089024:0@lo:101: 00000100:00100000:1.0:1788839210.738303:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.738342:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.738582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089024 00000100:00100000:0.0:1788839210.738590:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089024 00000100:00100000:0.0:1788839210.739940:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788839210.739958:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+12:7634:x1875733747089024:12345-0@lo:101: 00010000:00010000:0.0:1788839210.739975:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839210.739993:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fb7b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.740018:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.740029:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.740038:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6a00, rc 0) 00000100:00100000:0.0:1788839210.740118:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089024:12345-0@lo:101: Request processed in 168us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839210.740125:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788839210.740212:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089024:0@lo:101: 00010000:00010000:2.0:1788839210.740227:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.740236:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839210.740340:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089152:0@lo:501: 00000100:00100000:2.0:1788839210.740381:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.742727:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05914900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839210.742859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089152 00000100:00100000:1.0:1788839210.742867:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089152 00000100:00100000:1.0:1788839210.742913:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788839210.742921:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089152:12345-0@lo:501: 00000100:00100000:1.0:1788839210.743364:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089152:12345-0@lo:501: Request processed in 441us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.743372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788839210.753910:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089152:0@lo:501: 00000100:00100000:2.0:1788839210.753974:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089280:0@lo:503: 00000100:00100000:2.0:1788839210.754083:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.754124:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05914900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839210.754254:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089280 00000100:00100000:1.0:1788839210.754261:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089280 00000100:00100000:1.0:1788839210.754311:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788839210.754321:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089280:12345-0@lo:503: 00000100:00100000:1.0:1788839210.754817:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089280:12345-0@lo:503: Request processed in 497us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.754826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788839210.754922:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089280:0@lo:503: 00000040:00080000:2.0:1788839210.755356:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839210.755441:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089408:0@lo:502: 00000100:00100000:2.0:1788839210.755480:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.755516:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05914900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839210.755679:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089408 00000100:00100000:3.0:1788839210.755685:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089408 00000100:00100000:3.0:1788839210.755721:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839210.755730:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089408:12345-0@lo:502: 00000100:00100000:3.0:1788839210.755907:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089408:12345-0@lo:502: Request processed in 178us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.755915:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788839210.756119:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089408:0@lo:502: 00000040:00080000:2.0:1788839210.756443:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788839210.756492:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788839210.756517:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089536:0@lo:502: 00000100:00100000:2.0:1788839210.760743:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.760869:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05914900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839210.762990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089536 00000100:00100000:3.0:1788839210.763005:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089536 00000100:00100000:3.0:1788839210.763285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788839210.763299:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089536:12345-0@lo:502: 00000100:00100000:3.0:1788839210.763606:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089536:12345-0@lo:502: Request processed in 310us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.763613:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839210.763724:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089536:0@lo:502: 00000040:00080000:2.0:1788839210.763892:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788839210.763910:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788839210.764676:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839210.764685:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839210.764687:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788839210.764693:0:7645:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb02e9b800 00000020:00000080:2.0:1788839210.764695:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788839210.764715:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839210.764729:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839210.764730:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788839210.764734:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788839210.764896:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788839210.764917:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839210.764939:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.764951:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839210.764995:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788839210.764998:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eb02e9b800 10000000:01000000:1.0:1788839210.765001:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eb02e9b800 10000000:01000000:1.0:1788839210.765006:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839210.765011:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb02e9b800 from 1 10000000:01000000:1.0:1788839210.765013:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839210.765072:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.765091:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.765102:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839210.765123:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089664:0@lo:101: 00000100:00100000:1.0:1788839210.765191:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.774419:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.775947:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089664 00000100:00100000:0.0:1788839210.775960:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089664 00000100:00100000:0.0:1788839210.776022:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839210.776031:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747089664:12345-0@lo:101: 00010000:00010000:0.0:1788839210.776070:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839210.776091:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fb89 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.776122:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.776134:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839210.776259:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:0.0:1788839210.776596:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747089664:12345-0@lo:101: Request processed in 564us (11403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839210.776603:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788839210.780566:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089664:0@lo:101: 00010000:00010000:1.0:1788839210.780605:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.780619:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839210.780883:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089792:0@lo:501: 00000100:00100000:1.0:1788839210.780949:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.780992:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839210.781301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089792 00000100:00100000:3.0:1788839210.781308:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089792 00000100:00100000:3.0:1788839210.781363:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788839210.781372:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747089792:12345-0@lo:501: 00000100:00100000:3.0:1788839210.781766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747089792:12345-0@lo:501: Request processed in 392us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.781774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788839210.782996:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089792:0@lo:501: 00000100:00100000:1.0:1788839210.783081:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089920:0@lo:503: 00000100:00100000:1.0:1788839210.783141:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.783250:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839210.783673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747089920 00000100:00100000:2.0:1788839210.783680:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747089920 00000100:00100000:2.0:1788839210.783724:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788839210.783734:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747089920:12345-0@lo:503: 00000100:00100000:2.0:1788839210.783934:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747089920:12345-0@lo:503: Request processed in 201us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.783942:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788839210.784689:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747089920:0@lo:503: 00000040:00080000:1.0:1788839210.785006:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839210.785130:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747090048:0@lo:502: 00000100:00100000:1.0:1788839210.786252:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.786678:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.792221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090048 00000100:00100000:0.0:1788839210.792237:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090048 00000100:00100000:0.0:1788839210.792309:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788839210.792330:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747090048:12345-0@lo:502: 00000100:00100000:1.0:1788839210.793091:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747090048:12345-0@lo:502: Request processed in 759us (6928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.793102:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788839210.793307:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747090048:0@lo:502: 00000040:00080000:2.0:1788839210.793910:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788839210.793975:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788839210.794010:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788839210.794103:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788839210.794145:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788839210.794274:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788839210.794444:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788839210.800793:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788839210.800891:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788839210.800931:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788839210.801002:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788839210.801075:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788839210.801125:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788839210.801732:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788839210.801801:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788839210.801839:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788839210.801874:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788839210.801923:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788839210.801955:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788839210.801985:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788839210.802032:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788839210.802127:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788839210.802176:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788839210.802226:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788839210.802264:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788839210.802298:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788839210.802943:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788839210.802983:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788839210.803014:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788839210.803078:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788839210.803112:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788839210.803142:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788839210.803279:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788839210.803501:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788839210.803540:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788839210.803813:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788839210.803848:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788839210.803897:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747090176:0@lo:502: 00000100:00100000:3.0:1788839210.803978:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.804111:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02efc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839210.807412:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090176 00000100:00100000:0.0:1788839210.807429:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090176 00000100:00100000:1.0:1788839210.811465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788839210.811483:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747090176:12345-0@lo:502: 00000100:00100000:1.0:1788839210.812509:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747090176:12345-0@lo:502: Request processed in 1025us (8525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.812520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839210.813214:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747090176:0@lo:502: 00000040:00080000:3.0:1788839210.813452:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788839210.813473:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788839210.814980:0:7646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788839210.814999:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91eb33774d28) 00000020:00000080:3.0:1788839210.815021:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788839210.818770:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eb02e9b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839210.818781:0:7646:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eb02e9b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839210.818784:0:7646:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb02e9b800 3 00010000:00080000:2.0:1788839210.818822:0:7646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb02e9a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.109@tcp at head 00010000:00010000:2.0:1788839210.823122:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788839210.826651:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788839210.826708:0:7646:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839210.826722:0:7646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b63896d6363fb9e 00000100:00080000:2.0:1788839210.826733:0:7646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839210.826740:0:7646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91eb02e9a800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1788839210.826772:0:7646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb3375f480 x1875733747090304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839210.826819:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875733747090304:0@lo:38: 00000100:00100000:2.0:1788839210.826887:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.826956:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090304 00000100:00100000:2.0:1788839210.826964:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090304 00000100:00100000:2.0:1788839210.826992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839210.826999:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875733747090304:12345-0@lo:38: 00010000:00080000:2.0:1788839210.827021:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1788839210.827066:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b63896d6363fba5 00000004:00100000:2.0:1788839210.827081:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788839210.827110:0:5842:0:(import.c:65:import_set_state_nolock()) ffff91eb37d65800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839210.827156:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875733747090304:12345-0@lo:38: Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.827164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788839210.827201:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb3375f480 x1875733747090304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839210.827212:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839210.827219:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788839210.827225:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788839210.827229:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788839210.827231:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb02e9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788839210.827237:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875733747090304:0@lo:38: 00000100:00080000:2.0:1788839210.827255:0:7646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788839210.827607:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839210.827617:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747090432:0@lo:400: 00000100:00100000:3.0:1788839210.827649:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.827673:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747090560:0@lo:400: 00000100:00100000:3.0:1788839210.827695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.827709:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839210.827714:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747090688:0@lo:400: 00000100:00100000:3.0:1788839210.827735:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.827763:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090688 00000100:00100000:3.0:1788839210.827767:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090688 00000100:00100000:3.0:1788839210.827799:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839210.827806:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747090688:12345-0@lo:400: 00000100:00100000:3.0:1788839210.827843:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747090688:12345-0@lo:400: Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.827849:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788839210.827880:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb33768380 x1875733747090688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839210.827889:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747090688:0@lo:400: 00000100:00100000:3.0:1788839210.827904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090432 00000100:00100000:3.0:1788839210.827907:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090432 00000100:00100000:3.0:1788839210.827927:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090560 00000100:00100000:3.0:1788839210.827929:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090560 00000100:00100000:3.0:1788839210.827942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839210.827948:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747090432:12345-0@lo:400: 00000100:00100000:3.0:1788839210.827979:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747090432:12345-0@lo:400: Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.827996:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839210.828008:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839210.828013:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747090560:12345-0@lo:400: 00000100:00100000:3.0:1788839210.828044:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747090560:12345-0@lo:400: Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.828076:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788839210.828101:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb3376b100 x1875733747090432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839210.828111:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747090432:0@lo:400: 00010000:00080000:3.0:1788839210.828129:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb3376a680 x1875733747090560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839210.828137:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747090560:0@lo:400: 00000040:00080000:1.0:1788839210.832946:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788839210.833122:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788839210.833151:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839210.833166:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.833177:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788839210.833236:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788839210.833239:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839210.833240:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839210.833242:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839210.833243:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839210.833245:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839210.833246:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839210.833247:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788839210.833248:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788839210.833250:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839210.833251:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839210.833260:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788839210.833262:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839210.833264:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839210.833265:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839210.833266:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839210.833267:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839210.833268:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839210.833269:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839210.833270:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788839210.833271:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788839210.833272:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839210.833273:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839210.833300:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788839210.833319:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747090816:0@lo:253: 00000100:00100000:1.0:1788839210.833391:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839210.833430:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090816 00000100:00100000:1.0:1788839210.833437:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090816 00000100:00100000:1.0:1788839210.833478:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788839210.833486:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:7634:x1875733747090816:12345-0@lo:253: 20000000:01000000:1.0:1788839210.833524:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788839210.833539:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788839210.834232:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb15bbb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839210.835192:0:7648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1875733747090944:0@lo:901: 00000100:00100000:3.0:1788839210.835255:0:7648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839210.835289:0:7648:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb02efc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839210.835626:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747090944 00000100:00100000:1.0:1788839210.835634:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747090944 00000100:00100000:1.0:1788839210.838106:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839210.838122:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1875733747090944:12345-0@lo:901: 00000100:00100000:1.0:1788839210.838544:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1875733747090944:12345-0@lo:901: Request processed in 426us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.838552:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788839210.838639:0:7648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb3376a680 x1875733747090944/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788839226 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839210.838654:0:7648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1875733747090944:0@lo:901: 00000100:00080000:2.0:1788839210.847208:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1788839210.903146:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788839210.903185:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788839210.903333:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839210.903339:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839210.903383:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.903403:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.903413:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.903455:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.903472:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 14 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839210.903486:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875733747091072:0@lo:104: 00000100:00100000:2.0:1788839210.903553:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.903625:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb059149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839210.903747:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091072 00000100:00100000:3.0:1788839210.903755:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091072 00000100:00100000:3.0:1788839210.903811:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839210.903821:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5858:x1875733747091072:12345-0@lo:104: 00010000:00010000:3.0:1788839210.903834:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839210.903890:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839210.903897:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:5858:x1875733747091072:12345-0@lo:104: Request processed in 78us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839210.903914:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839210.903998:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875733747091072:0@lo:104: 00010000:00010000:2.0:1788839210.904018:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.904821:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839210.904831:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.904840:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb00030600 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:1.0:1788839210.904844:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.904855:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839210.904862:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839210.904869:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839210.904914:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.904922:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839210.904939:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.904946:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb00030600/0x4b63896d6363faf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fafd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.904969:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839210.904971:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839210.904973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839210.904990:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747091200:0@lo:103: 00000100:00100000:1.0:1788839210.905093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839210.905971:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091200 00000100:00100000:2.0:1788839210.905982:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091200 00010000:00010000:2.0:1788839210.906013:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 15 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839210.906294:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839210.906304:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+15:3313:x1875733747091200:12345-0@lo:103: 00010000:00010000:2.0:1788839210.906330:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839210.906350:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 15 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906363:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 15 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906378:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb00030800/0x4b63896d6363fafd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363faf6 expref: 15 pid: 5838 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906395:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906403:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788839210.906419:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003081036s 00010000:00010000:2.0:1788839210.906424:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906430:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906436:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906442:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906448:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839210.906453:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906460:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906486:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839210.906497:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839210.906553:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+14:3313:x1875733747091200:12345-0@lo:103: Request processed in 251us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839210.906561:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839210.906715:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747091200:0@lo:103: 00010000:00010000:1.0:1788839210.907080:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.907092:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839210.907099:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20965e00/0x4b63896d6363fbac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839210.916959:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:7634:x1875733747090816:12345-0@lo:253: Request processed in 83463us (83557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839210.916975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788839210.918522:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2841848a-c637-485f-b8f2-edd7dddc336d:7634:1875733747090816:0@lo:253: 10000000:01000000:2.0:1788839210.918543:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788839210.918547:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839210.918549:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839210.918550:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839210.918551:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839210.918552:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839210.918553:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839210.918554:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839210.918556:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839210.918557:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839210.918559:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839210.918560:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788839210.918584:0:7634:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788839210.925536:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788839210.925757:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788839210.925960:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788839210.926255:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788839210.926532:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788839210.926803:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788839210.927798:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788839211.150496:0:7634:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788839211.150506:0:7634:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788839211.150542:0:7634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788839211.150615:0:7634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788839211.150633:0:7634:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788839211.150661:0:7634:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788839211.389975:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839212.422238:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839213.439328:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839214.465838:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839215.421267:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839215.421295:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747091328:0@lo:13: 00000100:00100000:0.0:1788839215.421377:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839215.421552:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091328 00000100:00100000:2.0:1788839215.421562:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091328 00000100:00100000:2.0:1788839215.421626:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839215.421635:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747091328:12345-0@lo:13: 00002000:00000024:2.0:1788839215.421674:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839215.421737:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747091328:12345-0@lo:13: Request processed in 102us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839215.421744:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788839215.421800:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3375f480 x1875733747091328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839215.421819:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747091328:0@lo:13: 00000100:00080000:0.0:1788839215.421971:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839215.485219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839215.933270:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747091712:0@lo:400: 00000100:00100000:3.0:1788839215.933375:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839215.933450:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839215.933456:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747091840:0@lo:400: 00000100:00100000:3.0:1788839215.933476:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839215.933520:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091712 00000100:00100000:3.0:1788839215.933528:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091712 00000100:00100000:3.0:1788839215.933585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091840 00000100:00100000:3.0:1788839215.933590:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091840 00000100:00100000:3.0:1788839215.933613:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839215.933622:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747091712:12345-0@lo:400: 00000100:00100000:3.0:1788839215.933681:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747091712:12345-0@lo:400: Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839215.933704:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839215.933727:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839215.933734:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747091840:12345-0@lo:400: 00000100:00100000:3.0:1788839215.933777:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747091840:12345-0@lo:400: Request processed in 43us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839215.933782:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788839215.933821:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33768700 x1875733747091840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839215.933834:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747091840:0@lo:400: 00010000:00080000:3.0:1788839215.933844:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33769180 x1875733747091712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839215.933851:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747091712:0@lo:400: 00000100:00100000:0.0:1788839215.934108:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747091456:0@lo:400: 00000100:00100000:0.0:1788839215.934143:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839215.934183:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839215.934190:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747091584:0@lo:400: 00000100:00100000:0.0:1788839215.934212:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839215.934235:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839215.934245:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091584 00000100:00100000:0.0:1788839215.934248:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091584 00000100:00100000:0.0:1788839215.934276:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788839215.934282:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747091584:12345-0@lo:400: 00000100:00100000:0.0:1788839215.934316:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747091584:12345-0@lo:400: Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839215.934347:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788839215.934376:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33768e00 x1875733747091584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839215.934387:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747091584:0@lo:400: 00000100:00100000:3.0:1788839215.934662:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091456 00000100:00100000:3.0:1788839215.934667:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091456 00000100:00100000:3.0:1788839215.934708:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788839215.934716:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:3311:x1875733747091456:12345-0@lo:400: 00000100:00100000:3.0:1788839215.934751:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:3311:x1875733747091456:12345-0@lo:400: Request processed in 37us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839215.934758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788839215.934881:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747091456:0@lo:400: 00010000:00010000:2.0:1788839216.512037:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788839216.881640:0:7990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788839217.534148:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839218.557344:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788839219.519179:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788839219.519188:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb3bf58000 from 30 10000000:01000000:2.0:1788839219.519194:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839219.519241:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839219.519253:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839219.519264:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839219.519289:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747091968:0@lo:101: 00000100:00100000:2.0:1788839219.519361:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839219.519417:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea021a9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.519503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747091968 00000100:00100000:1.0:1788839219.519510:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747091968 00000100:00100000:1.0:1788839219.519577:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788839219.519587:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747091968:12345-0@lo:101: 00010000:00010000:1.0:1788839219.519603:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839219.519626:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fbb3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.519660:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.519688:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.519697:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e800, rc 0) 00000100:00100000:1.0:1788839219.519742:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747091968:12345-0@lo:101: Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.519749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788839219.519798:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747091968:0@lo:101: 00010000:00010000:1.0:1788839219.519812:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.519820:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839219.519875:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092096:0@lo:501: 00000100:00100000:1.0:1788839219.519900:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.519930:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea028e6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.519957:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092096 00000100:00100000:1.0:1788839219.519960:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092096 00000100:00100000:1.0:1788839219.519982:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839219.519988:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747092096:12345-0@lo:501: 00000100:00100000:1.0:1788839219.520394:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747092096:12345-0@lo:501: Request processed in 404us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.520401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839219.520450:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092096:0@lo:501: 00000100:00100000:1.0:1788839219.520479:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092224:0@lo:503: 00000100:00100000:1.0:1788839219.520524:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.520539:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea028e6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.520553:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092224 00000100:00100000:1.0:1788839219.520556:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092224 00000100:00100000:1.0:1788839219.520577:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839219.520584:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747092224:12345-0@lo:503: 00000100:00100000:1.0:1788839219.520872:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747092224:12345-0@lo:503: Request processed in 287us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.520879:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839219.520921:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092224:0@lo:503: 00000100:00100000:1.0:1788839219.521239:0:8100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8100:1875733747092352:0@lo:502: 00000100:00100000:1.0:1788839219.521276:0:8100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.521296:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092352 00000100:00100000:1.0:1788839219.521300:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092352 00000100:00100000:1.0:1788839219.521322:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788839219.521329:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:8100:x1875733747092352:12345-0@lo:502: 00000100:00100000:1.0:1788839219.521557:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:8100:x1875733747092352:12345-0@lo:502: Request processed in 228us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.521563:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788839219.521594:0:8100:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06444300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.521608:0:8100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8100:1875733747092352:0@lo:502: 00000100:00100000:1.0:1788839219.521650:0:8100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8100:1875733747092480:0@lo:502: 00000100:00100000:1.0:1788839219.521681:0:8100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.521699:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092480 00000100:00100000:1.0:1788839219.521703:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092480 00000100:00100000:1.0:1788839219.521723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788839219.521738:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:8100:x1875733747092480:12345-0@lo:502: 00000100:00100000:1.0:1788839219.521849:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:8100:x1875733747092480:12345-0@lo:502: Request processed in 113us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.521856:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788839219.521886:0:8100:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06444300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.521898:0:8100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8100:1875733747092480:0@lo:502: 00000040:00080000:1.0:1788839219.521917:0:8100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788839219.521976:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788839219.521998:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839219.522008:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.522017:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839219.522026:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788839219.522029:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788839219.522032:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788839219.522075:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.522083:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.522092:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839219.522104:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092608:0@lo:101: 00000100:00100000:1.0:1788839219.522129:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.522149:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.522160:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092608 00000100:00100000:1.0:1788839219.522163:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092608 00000100:00100000:1.0:1788839219.522180:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788839219.522186:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747092608:12345-0@lo:101: 00010000:00010000:1.0:1788839219.522194:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839219.522206:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fbc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.522225:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.522234:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.522243:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ec00, rc 0) 00000100:00100000:1.0:1788839219.522271:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747092608:12345-0@lo:101: Request processed in 84us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.522277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788839219.522305:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092608:0@lo:101: 00010000:00010000:1.0:1788839219.522317:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.522326:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839219.522363:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092736:0@lo:501: 00000100:00100000:1.0:1788839219.522388:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.522400:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.526215:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092736 00000100:00100000:1.0:1788839219.526236:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092736 00000100:00100000:1.0:1788839219.526311:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839219.526321:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747092736:12345-0@lo:501: 00000100:00100000:1.0:1788839219.526686:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747092736:12345-0@lo:501: Request processed in 366us (4297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.526695:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839219.526752:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092736:0@lo:501: 00000100:00100000:1.0:1788839219.526929:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092864:0@lo:503: 00000100:00100000:1.0:1788839219.526974:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.527007:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.527177:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092864 00000100:00100000:0.0:1788839219.527182:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092864 00000100:00100000:0.0:1788839219.527214:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788839219.527221:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747092864:12345-0@lo:503: 00000100:00100000:0.0:1788839219.527541:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747092864:12345-0@lo:503: Request processed in 319us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839219.527548:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788839219.527606:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747092864:0@lo:503: 00000100:00100000:0.0:1788839219.528398:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8101:1875733747092992:0@lo:502: 00000100:00100000:0.0:1788839219.528462:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.528504:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839219.530172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747092992 00000100:00100000:3.0:1788839219.530186:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747092992 00000100:00100000:3.0:1788839219.530243:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788839219.530252:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:8101:x1875733747092992:12345-0@lo:502: 00000100:00100000:3.0:1788839219.530575:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:8101:x1875733747092992:12345-0@lo:502: Request processed in 323us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839219.530582:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788839219.533546:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8101:1875733747092992:0@lo:502: 00000020:01000000:0.0:1788839219.533614:0:8101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839219.533630:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839219.533633:0:8101:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788839219.533639:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788839219.533640:0:8101:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788839219.533679:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8101:1875733747093120:0@lo:502: 00000100:00100000:0.0:1788839219.533755:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.534176:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747093120 00000100:00100000:1.0:1788839219.534184:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747093120 00000100:00100000:1.0:1788839219.534235:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788839219.534244:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:8101:x1875733747093120:12345-0@lo:502: 00000100:00100000:1.0:1788839219.539796:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:8101:x1875733747093120:12345-0@lo:502: Request processed in 5534us (6022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.539811:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788839219.540402:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.540453:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8101:1875733747093120:0@lo:502: 00000020:01000000:0.0:1788839219.540496:0:8101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839219.540504:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839219.540506:0:8101:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788839219.540510:0:8101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788839219.542093:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788839219.542119:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788839219.542130:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839219.542143:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839219.542154:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788839219.542156:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb02d49000 from 30 10000000:01000000:2.0:1788839219.542166:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839219.542203:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839219.542211:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839219.542221:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839219.542244:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093248:0@lo:101: 00000100:00100000:2.0:1788839219.542309:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839219.542348:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea021a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.542745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747093248 00000100:00100000:0.0:1788839219.542752:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747093248 00000100:00100000:0.0:1788839219.542809:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788839219.542818:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747093248:12345-0@lo:101: 00010000:00010000:0.0:1788839219.542831:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839219.542844:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fbcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.542869:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.542881:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.542889:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:0.0:1788839219.542941:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747093248:12345-0@lo:101: Request processed in 124us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839219.542948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788839219.543111:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093248:0@lo:101: 00010000:00010000:2.0:1788839219.543125:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839219.543133:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839219.543181:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093376:0@lo:501: 00000100:00100000:2.0:1788839219.543208:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839219.543232:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea021a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839219.543246:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747093376 00000100:00100000:2.0:1788839219.543249:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747093376 00000100:00100000:2.0:1788839219.543273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788839219.543280:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747093376:12345-0@lo:501: 00000100:00100000:2.0:1788839219.543720:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747093376:12345-0@lo:501: Request processed in 439us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839219.543738:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788839219.543843:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093376:0@lo:501: 00000100:00100000:2.0:1788839219.543884:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093504:0@lo:503: 00000100:00100000:2.0:1788839219.543922:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839219.543936:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea021a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839219.543949:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747093504 00000100:00100000:2.0:1788839219.543953:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747093504 00000100:00100000:2.0:1788839219.543975:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839219.543981:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747093504:12345-0@lo:503: 00000100:00100000:2.0:1788839219.544731:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747093504:12345-0@lo:503: Request processed in 746us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839219.544739:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788839219.547944:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093504:0@lo:503: 00000100:00100000:1.0:1788839219.548679:0:8103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8103:1875733747093632:0@lo:502: 00000100:00100000:1.0:1788839219.548767:0:8103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.550256:0:8103:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839219.557634:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747093632 00000100:00100000:3.0:1788839219.557650:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747093632 00000100:00100000:2.0:1788839219.558434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839219.558447:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:8103:x1875733747093632:12345-0@lo:502: 00000100:00100000:2.0:1788839219.558771:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:8103:x1875733747093632:12345-0@lo:502: Request processed in 325us (10003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839219.558779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788839219.559966:0:8103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8103:1875733747093632:0@lo:502: 00000100:00100000:1.0:1788839219.560092:0:8103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8103:1875733747093760:0@lo:502: 00000100:00100000:1.0:1788839219.560173:0:8103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.560219:0:8103:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.560296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747093760 00000100:00100000:0.0:1788839219.560304:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747093760 00000100:00100000:0.0:1788839219.560342:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788839219.560351:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+16:8103:x1875733747093760:12345-0@lo:502: 00000100:00100000:0.0:1788839219.560704:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+16:8103:x1875733747093760:12345-0@lo:502: Request processed in 352us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839219.560720:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788839219.562825:0:8103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8103:1875733747093760:0@lo:502: 00000040:00080000:1.0:1788839219.562879:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788839219.564084:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788839219.564119:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788839219.564131:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.564143:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839219.564153:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788839219.564156:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eb02d49000 from 5 10000000:01000000:0.0:1788839219.564159:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839219.564200:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.564208:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.564218:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839219.564239:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093888:0@lo:101: 00000100:00100000:0.0:1788839219.564302:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.564351:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50600 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.564439:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747093888 00000100:00100000:1.0:1788839219.564446:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747093888 00000100:00100000:1.0:1788839219.564492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788839219.564502:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747093888:12345-0@lo:101: 00010000:00010000:1.0:1788839219.564515:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839219.564528:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6f000/0x4b63896d6363fbe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fbdd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.564550:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6f000/0x4b63896d6363fbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fbdd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.564559:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6f000/0x4b63896d6363fbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbdd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.564581:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f000, rc 0) 00000100:00100000:1.0:1788839219.564621:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747093888:12345-0@lo:101: Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.564628:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788839219.564677:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747093888:0@lo:101: 00010000:00010000:1.0:1788839219.564690:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.564699:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839219.564749:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094016:0@lo:256: 00000100:00100000:1.0:1788839219.564908:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.564933:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.564948:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094016 00000100:00100000:1.0:1788839219.564952:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094016 00000100:00100000:1.0:1788839219.564975:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788839219.564982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747094016:12345-0@lo:256: 20000000:01000000:1.0:1788839219.564995:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788839219.565012:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788839219.565016:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788839219.565120:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747094016:12345-0@lo:256: Request processed in 137us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.565128:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788839219.565160:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094016:0@lo:256: 10000000:01000000:1.0:1788839219.565201:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839219.565207:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.565215:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839219.565222:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788839219.565224:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788839219.565226:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788839219.565243:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.565250:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.565257:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839219.565280:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094144:0@lo:101: 00000100:00100000:1.0:1788839219.565305:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.565320:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.565332:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094144 00000100:00100000:1.0:1788839219.565336:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094144 00000100:00100000:1.0:1788839219.565359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839219.565366:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747094144:12345-0@lo:101: 00010000:00010000:1.0:1788839219.565373:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839219.565383:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fbeb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.565398:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.565407:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.565413:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:1.0:1788839219.565456:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747094144:12345-0@lo:101: Request processed in 90us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.565462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839219.565491:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094144:0@lo:101: 00010000:00010000:1.0:1788839219.565501:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.565509:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839219.569712:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094272:0@lo:501: 00000100:00100000:1.0:1788839219.569865:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.569902:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.569936:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094272 00000100:00100000:1.0:1788839219.569944:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094272 00000100:00100000:1.0:1788839219.569991:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788839219.570001:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747094272:12345-0@lo:501: 00000100:00100000:1.0:1788839219.570320:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747094272:12345-0@lo:501: Request processed in 319us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.570327:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788839219.570380:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094272:0@lo:501: 00000100:00100000:1.0:1788839219.570437:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094400:0@lo:503: 00000100:00100000:1.0:1788839219.570478:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839219.570493:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.570507:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094400 00000100:00100000:1.0:1788839219.570511:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094400 00000100:00100000:1.0:1788839219.570534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788839219.570541:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747094400:12345-0@lo:503: 00000100:00100000:1.0:1788839219.571530:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747094400:12345-0@lo:503: Request processed in 986us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.571539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788839219.571689:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747094400:0@lo:503: 00000100:00100000:3.0:1788839219.576147:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8105:1875733747094528:0@lo:502: 00000100:00100000:3.0:1788839219.576252:0:8105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839219.576304:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.576405:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094528 00000100:00100000:1.0:1788839219.576413:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094528 00000100:00100000:1.0:1788839219.576469:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788839219.576479:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+18:8105:x1875733747094528:12345-0@lo:502: 00000100:00100000:1.0:1788839219.577024:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+18:8105:x1875733747094528:12345-0@lo:502: Request processed in 544us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.577033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788839219.577167:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8105:1875733747094528:0@lo:502: 00000020:01000000:0.0:1788839219.577198:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788839219.577206:0:8105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788839219.577213:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839219.577216:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788839219.577226:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788839219.577230:0:8105:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:0.0:1788839219.577254:0:8105:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788839219.577257:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788839219.577272:0:8105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91eb0f904d28) 00000020:00000080:0.0:1788839219.577294:0:8105:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788839219.577300:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788839219.577370:0:8105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788839219.577376:0:8105:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788839219.577382:0:8105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d6363fc00 00010000:00080000:0.0:1788839219.577427:0:8105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb0a5ad000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1788839219.577718:0:8105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788839219.578719:0:8105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788839219.579636:0:8105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788839219.581046:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839219.581345:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839219.581404:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788839219.581479:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00010000:3.0:1788839219.581666:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839219.583190:0:8106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839219.583197:0:8106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788839219.584442:0:8105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839219.584457:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788839219.584496:0:8105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788839219.584522:0:8105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d6363fc07 00000100:00080000:1.0:1788839219.584533:0:8105:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839219.584538:0:8105:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eb0a5ad000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:1.0:1788839219.584648:0:8105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb1e5c7480 x1875733747094656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839219.584668:0:8105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788839219.584692:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747094656:0@lo:8: 00000020:01000000:1.0:1788839219.584720:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839219.584726:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839219.584728:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788839219.584732:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1788839219.584771:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839219.584843:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094656 00000100:00100000:2.0:1788839219.584851:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094656 00000100:00100000:0.0:1788839219.585010:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747094784:0@lo:400: 00000100:00100000:0.0:1788839219.585070:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.585188:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094784 00000100:00100000:0.0:1788839219.585193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094784 00000100:00100000:0.0:1788839219.585228:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839219.585237:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747094784:12345-0@lo:400: 00000100:00100000:0.0:1788839219.585290:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747094784:12345-0@lo:400: Request processed in 54us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839219.585298:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788839219.585333:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33768700 x1875733747094784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839219.585347:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747094784:0@lo:400: 00000100:00100000:3.0:1788839219.585473:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747095040:0@lo:400: 00000100:00100000:3.0:1788839219.585506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839219.585528:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839219.585534:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747095168:0@lo:400: 00000100:00100000:3.0:1788839219.585557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839219.585596:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095040 00000100:00100000:3.0:1788839219.585600:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095040 00000100:00100000:3.0:1788839219.585638:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839219.585646:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747095040:12345-0@lo:400: 00000100:00100000:3.0:1788839219.585684:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747095040:12345-0@lo:400: Request processed in 39us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839219.585691:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839219.585706:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839219.585710:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875733747094656:12345-0@lo:8: 00010000:00080000:3.0:1788839219.585733:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1788839219.585757:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d6363fc0e 00002000:00100000:3.0:1788839219.585771:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91eb03063000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788839219.585902:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788839219.585917:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788839219.586044:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788839219.586224:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788839219.586265:0:6696:0:(import.c:65:import_set_state_nolock()) ffff91eb408c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839219.586312:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875733747094656:12345-0@lo:8: Request processed in 599us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839219.586319:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788839219.586355:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3376a680 x1875733747095040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839219.586367:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747095040:0@lo:400: 00000020:00000080:1.0:1788839219.586478:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839219.586481:0:8105:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788839219.586488:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788839219.586490:0:8105:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788839219.586512:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8105:1875733747095296:0@lo:502: 00000100:00100000:1.0:1788839219.586558:0:8105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.586668:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095168 00000100:00100000:0.0:1788839219.586673:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095168 00000100:00100000:0.0:1788839219.586718:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839219.586726:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747095168:12345-0@lo:400: 00000100:00100000:0.0:1788839219.586770:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747095168:12345-0@lo:400: Request processed in 45us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.588018:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd70c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788839219.588094:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839219.588100:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839219.588109:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839219.588126:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747094912:0@lo:400: 00000100:00100000:1.0:1788839219.588173:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.588256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839219.588291:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747094912 00000100:00100000:0.0:1788839219.588298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747094912 00000100:00100000:0.0:1788839219.588339:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839219.588347:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747094912:12345-0@lo:400: 00000100:00100000:0.0:1788839219.588397:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747094912:12345-0@lo:400: Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839219.588403:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788839219.588463:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33768700 x1875733747095168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839219.588477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747095168:0@lo:400: 00000100:00080000:0.0:1788839219.588494:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788839219.588511:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33769500 x1875733747094912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839219.588519:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747094912:0@lo:400: 00000100:00100000:3.0:1788839219.588671:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095296 00000100:00100000:3.0:1788839219.588676:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095296 00000100:00100000:3.0:1788839219.588713:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788839219.588720:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:8105:x1875733747095296:12345-0@lo:502: 00000100:00100000:3.0:1788839219.588990:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:8105:x1875733747095296:12345-0@lo:502: Request processed in 269us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839219.588996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839219.589137:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8105:1875733747095296:0@lo:502: 00000020:01000000:0.0:1788839219.589163:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839219.589170:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839219.589172:0:8105:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788839219.589176:0:8105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788839219.589484:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788839219.589506:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788839219.589516:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839219.589527:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839219.589538:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788839219.589540:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eb09e08000 from 1 10000000:01000000:3.0:1788839219.589543:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839219.589603:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839219.589611:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839219.589619:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839219.589635:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747095424:0@lo:101: 00000100:00100000:3.0:1788839219.589669:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839219.589705:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.589875:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095424 00000100:00100000:1.0:1788839219.589881:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095424 00000100:00100000:1.0:1788839219.589920:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839219.589928:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747095424:12345-0@lo:101: 00010000:00010000:1.0:1788839219.589940:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839219.589956:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fc15 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.589980:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.589991:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839219.589999:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f600, rc 0) 00000100:00100000:1.0:1788839219.590070:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747095424:12345-0@lo:101: Request processed in 120us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.590077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788839219.590515:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747095424:0@lo:101: 00010000:00010000:0.0:1788839219.590532:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.590551:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839219.590618:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747095552:0@lo:501: 00000100:00100000:0.0:1788839219.590650:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.590686:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb061603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839219.590729:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095552 00000100:00100000:1.0:1788839219.590734:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095552 00000100:00100000:1.0:1788839219.590767:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788839219.590774:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747095552:12345-0@lo:501: 00000100:00100000:1.0:1788839219.591036:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747095552:12345-0@lo:501: Request processed in 261us (383us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839219.591079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788839219.591475:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747095552:0@lo:501: 10000000:01000000:0.0:1788839219.591508:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788839219.591517:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839219.591525:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788839219.593171:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb1e5c7480 x1875733747094656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839219.593186:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839219.593197:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788839219.593213:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788839219.593219:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788839219.593224:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb0a5ad000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788839219.593243:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788839219.593251:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747094656:0@lo:8: 00000004:00080000:1.0:1788839219.597005:0:8106:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788839219.597142:0:8106:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 202288091121ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788839219.681175:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788839219.682300:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839219.682326:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747095680:0@lo:13: 00000100:00100000:3.0:1788839219.682410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839219.682492:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095680 00000100:00100000:3.0:1788839219.682500:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095680 00000100:00100000:3.0:1788839219.682559:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839219.682568:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747095680:12345-0@lo:13: 00002000:00000024:3.0:1788839219.682605:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788839219.682649:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747095680:12345-0@lo:13: Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839219.682657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788839219.682677:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788839219.682707:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33768e00 x1875733747095680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839219.682728:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747095680:0@lo:13: 00000004:00080000:3.0:1788839219.682766:0:8107:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788839219.682798:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747095808:0@lo:7: 00000100:00100000:3.0:1788839219.682825:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839219.682848:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.682894:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095808 00000100:00100000:0.0:1788839219.682901:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095808 00000100:00100000:0.0:1788839219.682947:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839219.682956:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8107:x1875733747095808:12345-0@lo:7: 00002000:00080000:1.0:1788839219.690300:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788839219.690309:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788839219.690413:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8107:x1875733747095808:12345-0@lo:7: Request processed in 7454us (7582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839219.690436:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788839219.690471:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33768e00 x1875733747095808/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839235 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839219.690486:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747095808:0@lo:7: 00000004:00080000:2.0:1788839219.690500:0:8107:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788839219.690552:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747095936:0@lo:5: 00000100:00100000:2.0:1788839219.690588:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.690632:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747095936 00000100:00100000:2.0:1788839219.690635:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea021a90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.690640:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747095936 00000100:00100000:0.0:1788839219.690690:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839219.690700:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8107:x1875733747095936:12345-0@lo:5: 00002000:00080000:0.0:1788839219.690724:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788839219.690729:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788839219.691311:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8107:x1875733747095936:12345-0@lo:5: Request processed in 611us (721us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788839219.691328:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788839219.691381:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3375f480 x1875733747095936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839235 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839219.691394:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747095936:0@lo:5: 00000004:00080000:2.0:1788839219.691403:0:8107:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788839219.691441:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747096064:0@lo:700: 00000100:00100000:2.0:1788839219.691469:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839219.691491:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea021a90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.691506:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096064 00000100:00100000:0.0:1788839219.691510:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096064 00000100:00100000:0.0:1788839219.691541:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839219.691546:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8107:x1875733747096064:12345-0@lo:700: 00000100:00100000:0.0:1788839219.691570:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1875733747096192:0@lo:700: 00000100:00100000:0.0:1788839219.691598:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.691618:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839219.692108:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096192 00000100:00100000:0.0:1788839219.692113:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096192 00000100:00100000:0.0:1788839219.692147:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839219.692153:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1875733747096192:12345-0@lo:700: 40000000:02000000:0.0:1788839219.764658:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788839219.771710:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1875733747096192:12345-0@lo:700: Request processed in 79548us (80102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839219.771725:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788839219.771885:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8fa680 x1875733747096192/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788839235 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839219.771902:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1875733747096192:0@lo:700: 40000000:02000000:0.0:1788839219.771916:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788839219.851973:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8107:x1875733747096064:12345-0@lo:700: Request processed in 160416us (160493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839219.851992:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1788839219.852070:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788839219.852086:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788839219.852175:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3375e680 x1875733747096064/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788839235 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839219.852191:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747096064:0@lo:700: 00000004:02000040:0.0:1788839219.892773:0:8107:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788839219.898660:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747096320:0@lo:5: 00000100:00100000:0.0:1788839219.898736:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839219.898800:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839219.898960:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096320 00000100:00100000:3.0:1788839219.898970:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096320 00000100:00100000:3.0:1788839219.899069:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839219.899083:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8107:x1875733747096320:12345-0@lo:5: 00002000:00080000:3.0:1788839219.905890:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788839219.905917:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788839219.909644:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8107:x1875733747096320:12345-0@lo:5: Request processed in 10557us (10902us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788839219.909658:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788839219.909780:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8fa680 x1875733747096320/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839235 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839219.909795:0:8107:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788839219.909810:0:8107:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eb0f8fa680 x1875733747096320/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839235 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839219.909822:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875733747096320:0@lo:5: 00000004:00080000:0.0:1788839219.909836:0:8107:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788839220.541738:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747096448:0@lo:13: 00000100:00100000:1.0:1788839220.541821:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839220.541921:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096448 00000100:00100000:2.0:1788839220.541927:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096448 00000100:00100000:2.0:1788839220.541971:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839220.541978:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747096448:12345-0@lo:13: 00002000:00000024:2.0:1788839220.542018:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839220.542095:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747096448:12345-0@lo:13: Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839220.542102:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788839220.542227:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3375d500 x1875733747096448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839220.542246:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747096448:0@lo:13: 00010000:00010000:2.0:1788839220.611924:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839221.630651:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839221.637838:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788839222.186539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839222.187134:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729247360 00000100:00100000:0.0:1788839222.187145:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729247360 00000100:00100000:0.0:1788839222.187196:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:0.0:1788839222.187204:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2354:x1875733729247360:12345-192.168.201.9@tcp:250: 00010000:00080000:0.0:1788839222.187233:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7913c62c-0094-46f9-ba19-31fffcffa164@192.168.201.9@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1788839222.187263:0:5836:0:(genops.c:1385:class_connect()) connect: client 7913c62c-0094-46f9-ba19-31fffcffa164, cookie 0x4b63896d6363fc23 00000100:00080000:0.0:1788839222.187502:0:5836:0:(import.c:65:import_set_state_nolock()) ffff91eb0a5a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839222.187576:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+5:2354:x1875733729247360:12345-192.168.201.9@tcp:250: Request processed in 371us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839222.187584:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:0.0:1788839222.190723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839222.190795:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729247488 00000100:00100000:3.0:1788839222.190807:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729247488 00000100:00100000:3.0:1788839222.190873:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:3.0:1788839222.190882:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+5:5583:x1875733729247488:12345-192.168.201.9@tcp:101: 00010000:00010000:3.0:1788839222.190898:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839222.190916:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae03 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839222.190969:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839222.190982:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839222.190991:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14528000, rc 0) 00000100:00100000:3.0:1788839222.191572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+6:5583:x1875733729247488:12345-192.168.201.9@tcp:101: Request processed in 688us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839222.191580:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:3.0:1788839222.216365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839222.216524:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729247616 00000100:00100000:2.0:1788839222.216534:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729247616 00000100:00100000:2.0:1788839222.216585:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:2.0:1788839222.216594:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+6:5583:x1875733729247616:12345-192.168.201.9@tcp:501: 00000100:00100000:2.0:1788839222.216904:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+6:5583:x1875733729247616:12345-192.168.201.9@tcp:501: Request processed in 309us (561us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839222.216912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:3.0:1788839222.228906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839222.229038:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729247744 00000100:00100000:1.0:1788839222.229047:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729247744 00000100:00100000:1.0:1788839222.229128:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:1.0:1788839222.229138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+6:5583:x1875733729247744:12345-192.168.201.9@tcp:101: 00010000:00010000:1.0:1788839222.229154:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839222.229173:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae0a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839222.229202:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839222.229214:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839222.229244:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e400, rc 0) 00000100:00100000:1.0:1788839222.229305:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+7:5583:x1875733729247744:12345-192.168.201.9@tcp:101: Request processed in 168us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839222.229312:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:0.0:1788839222.232432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839222.235162:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729247872 00000100:00100000:3.0:1788839222.235176:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729247872 00000100:00100000:3.0:1788839222.235239:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:3.0:1788839222.235248:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+7:5583:x1875733729247872:12345-192.168.201.9@tcp:501: 00000100:00100000:3.0:1788839222.235716:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+8:5583:x1875733729247872:12345-192.168.201.9@tcp:501: Request processed in 467us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839222.235725:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:3.0:1788839222.238852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839222.239464:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248000 00000100:00100000:0.0:1788839222.239475:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248000 00000100:00100000:0.0:1788839222.239524:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:0.0:1788839222.239534:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+8:5583:x1875733729248000:12345-192.168.201.9@tcp:503: 00000100:00100000:0.0:1788839222.239821:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+8:5583:x1875733729248000:12345-192.168.201.9@tcp:503: Request processed in 288us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839222.239829:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:2.0:1788839222.263221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839222.263314:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248128 00000100:00100000:3.0:1788839222.263326:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248128 00000100:00100000:3.0:1788839222.263426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:3.0:1788839222.263446:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+8:5601:x1875733729248128:12345-192.168.201.9@tcp:502: 00000100:00100000:3.0:1788839222.263861:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+8:5601:x1875733729248128:12345-192.168.201.9@tcp:502: Request processed in 424us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839222.263879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:3.0:1788839222.287635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839222.289164:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248256 00000100:00100000:2.0:1788839222.289177:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248256 00000100:00100000:2.0:1788839222.289238:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:2.0:1788839222.289249:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+8:5601:x1875733729248256:12345-192.168.201.9@tcp:502: 00000100:00100000:2.0:1788839222.289677:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+8:5601:x1875733729248256:12345-192.168.201.9@tcp:502: Request processed in 428us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839222.289685:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:3.0:1788839222.300001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839222.300626:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248384 00000100:00100000:2.0:1788839222.300636:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248384 00000100:00100000:2.0:1788839222.300695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:2.0:1788839222.300707:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+8:5583:x1875733729248384:12345-192.168.201.9@tcp:101: 00010000:00010000:2.0:1788839222.300724:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839222.300744:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964000/0x4b63896d6363fc38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae34 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839222.300792:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964000/0x4b63896d6363fc38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae34 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839222.300803:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964000/0x4b63896d6363fc38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae34 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839222.300813:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964000, rc 0) 00000100:00100000:2.0:1788839222.300876:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+9:5583:x1875733729248384:12345-192.168.201.9@tcp:101: Request processed in 172us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839222.300883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:3.0:1788839222.307516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839222.307556:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248512 00000100:00100000:3.0:1788839222.307566:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248512 00000100:00100000:3.0:1788839222.307615:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:3.0:1788839222.307626:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+9:5583:x1875733729248512:12345-192.168.201.9@tcp:256: 20000000:01000000:3.0:1788839222.307653:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788839222.307674:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788839222.307678:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788839222.307681:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788839222.307683:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788839222.310895:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+9:5583:x1875733729248512:12345-192.168.201.9@tcp:256: Request processed in 3261us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839222.310909:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:2.0:1788839222.319302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839222.320438:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248640 00000100:00100000:0.0:1788839222.320451:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248640 00000100:00100000:0.0:1788839222.320515:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:0.0:1788839222.320529:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+9:5583:x1875733729248640:12345-192.168.201.9@tcp:101: 00010000:00010000:0.0:1788839222.320549:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839222.320570:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae3b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839222.320602:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839222.320613:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839222.320623:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6400, rc 0) 00000100:00100000:0.0:1788839222.320682:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:5583:x1875733729248640:12345-192.168.201.9@tcp:101: Request processed in 156us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839222.320691:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:0.0:1788839222.324562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839222.324805:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248768 00000100:00100000:3.0:1788839222.324816:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248768 00000100:00100000:3.0:1788839222.325186:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:3.0:1788839222.325199:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5583:x1875733729248768:12345-192.168.201.9@tcp:501: 00000100:00100000:3.0:1788839222.325477:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5583:x1875733729248768:12345-192.168.201.9@tcp:501: Request processed in 280us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839222.325485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:1.0:1788839222.328784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839222.328976:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729248896 00000100:00100000:0.0:1788839222.328985:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729248896 00000100:00100000:0.0:1788839222.329032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:0.0:1788839222.329041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:5583:x1875733729248896:12345-192.168.201.9@tcp:503: 00000100:00100000:0.0:1788839222.329632:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:5583:x1875733729248896:12345-192.168.201.9@tcp:503: Request processed in 590us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839222.329646:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:1.0:1788839222.332671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839222.332763:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249024 00000100:00100000:3.0:1788839222.332773:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249024 00000100:00100000:3.0:1788839222.332943:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00100000:3.0:1788839222.332955:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5606:x1875733729249024:12345-192.168.201.9@tcp:502: 00000100:00100000:3.0:1788839222.333234:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5606:x1875733729249024:12345-192.168.201.9@tcp:502: Request processed in 280us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839222.333252:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00100000:1.0:1788839222.335570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839222.335648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249152 00000100:00100000:3.0:1788839222.335657:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249152 00000100:00100000:3.0:1788839222.335700:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:3.0:1788839222.335711:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:5606:x1875733729249152:12345-192.168.201.9@tcp:502: 00000100:00100000:3.0:1788839222.336504:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:5606:x1875733729249152:12345-192.168.201.9@tcp:502: Request processed in 792us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839222.336513:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:1.0:1788839222.351159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839222.351635:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249280 00000100:00100000:2.0:1788839222.351645:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249280 00000100:00100000:2.0:1788839222.351694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:2.0:1788839222.351703:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1875733729249280:12345-192.168.201.9@tcp:38: 00010000:00080000:2.0:1788839222.351732:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1788839222.352493:0:5844:0:(genops.c:1385:class_connect()) connect: client 07d32060-78a7-4509-9f5d-feb437ccdae6, cookie 0x4b63896d6363fc46 00000004:00100000:2.0:1788839222.352522:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788839222.352529:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788839222.390682:0:5844:0:(import.c:65:import_set_state_nolock()) ffff91eb37d64800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839222.390776:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2354:x1875733729249280:12345-192.168.201.9@tcp:38: Request processed in 39072us (39622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839222.390787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00010000:00010000:2.0:1788839222.653299:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839223.403717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839223.403818:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249408 00000100:00100000:0.0:1788839223.403829:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249408 00000100:00080000:3.0:1788839223.403959:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839223.404106:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:0.0:1788839223.404119:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:0:x1875733729249408:12345-192.168.201.9@tcp:41: 00000004:00000024:0.0:1788839223.404235:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788839223.404424:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:0:x1875733729249408:12345-192.168.201.9@tcp:41: Request processed in 298us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839223.404433:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:0.0:1788839223.419091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839223.424440:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249536 00000100:00100000:2.0:1788839223.424456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249536 00000100:00100000:2.0:1788839223.424529:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1788839223.424540:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5583:x1875733729249536:12345-192.168.201.9@tcp:41: 00000004:00000024:2.0:1788839223.424571:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788839223.424656:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5583:x1875733729249536:12345-192.168.201.9@tcp:41: Request processed in 117us (5576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839223.424663:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:1.0:1788839223.432324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839223.432550:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249664 00000100:00100000:0.0:1788839223.432559:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249664 00000100:00100000:0.0:1788839223.432617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:0.0:1788839223.432628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5583:x1875733729249664:12345-192.168.201.9@tcp:40: 00000100:00100000:0.0:1788839223.432715:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5583:x1875733729249664:12345-192.168.201.9@tcp:40: Request processed in 89us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839223.432723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:3.0:1788839223.435823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839223.435895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839223.436277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250176 00000100:00100000:2.0:1788839223.436287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250176 00000100:00100000:2.0:1788839223.436357:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 127 00000100:00100000:2.0:1788839223.436368:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2356:x1875733729250176:12345-192.168.201.9@tcp:400: 00000100:00100000:2.0:1788839223.436453:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2356:x1875733729250176:12345-192.168.201.9@tcp:400: Request processed in 86us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839223.436461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 127 00000100:00100000:0.0:1788839223.436655:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250048 00000100:00100000:0.0:1788839223.436660:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250048 00000100:00100000:0.0:1788839223.436695:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:0.0:1788839223.436703:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5583:x1875733729250048:12345-192.168.201.9@tcp:33: 00000100:00100000:1.0:1788839223.450508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839223.450551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839223.455468:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249792 00000100:00100000:3.0:1788839223.455482:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249792 00000100:00100000:3.0:1788839223.455525:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729249920 00000100:00100000:3.0:1788839223.455528:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729249920 00000100:00100000:3.0:1788839223.455547:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1788839223.455556:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875733729249792:12345-192.168.201.9@tcp:8: 00010000:00080000:3.0:1788839223.455589:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1788839223.455624:0:6698:0:(genops.c:1385:class_connect()) connect: client 07d32060-78a7-4509-9f5d-feb437ccdae6, cookie 0x4b63896d6363fc4d 00002000:00100000:3.0:1788839223.455635:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07d32060-78a7-4509-9f5d-feb437ccdae6/ffff91eb408c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788839223.455654:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788839223.455923:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788839223.455954:0:6698:0:(import.c:65:import_set_state_nolock()) ffff91eb408c5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839223.456009:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2354:x1875733729249792:12345-192.168.201.9@tcp:8: Request processed in 454us (5512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839223.456015:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1788839223.456041:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:3.0:1788839223.456044:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875733729249920:12345-192.168.201.9@tcp:8: 00010000:00080000:3.0:1788839223.456084:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1788839223.456096:0:6698:0:(genops.c:1385:class_connect()) connect: client 07d32060-78a7-4509-9f5d-feb437ccdae6, cookie 0x4b63896d6363fc54 00002000:00100000:3.0:1788839223.456100:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07d32060-78a7-4509-9f5d-feb437ccdae6/ffff91eb408c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788839223.456110:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788839223.456261:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788839223.456275:0:6698:0:(import.c:65:import_set_state_nolock()) ffff91eb408c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839223.456300:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2354:x1875733729249920:12345-192.168.201.9@tcp:8: Request processed in 253us (5748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839223.456306:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000004:00080000:0.0:1788839223.482152:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 45387us 00000004:00200000:0.0:1788839223.498072:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788839223.498181:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5583:x1875733729250048:12345-192.168.201.9@tcp:33: Request processed in 61474us (62365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839223.498202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00010000:00010000:3.0:1788839223.677239:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839223.748386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839223.749131:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250304 00000100:00100000:0.0:1788839223.749146:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250304 00000100:00100000:0.0:1788839223.749222:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1788839223.749234:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5624:x1875733729250304:12345-192.168.201.9@tcp:101: 00010000:00010000:0.0:1788839223.749255:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839223.749326:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fc5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839223.749400:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fc62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839223.749414:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fc62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839223.749429:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fc62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839223.749465:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839223.749469:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839223.749484:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fc62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839223.749508:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fc5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae65 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839223.749527:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fc62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae65 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839223.749553:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280300) 00010000:00010000:0.0:1788839223.749556:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839223.749560:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7600, rc 0) 00000100:00100000:0.0:1788839223.749626:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:5624:x1875733729250304:12345-192.168.201.9@tcp:101: Request processed in 394us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839223.749634:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:1.0:1788839224.637272:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747096704:0@lo:400: 00000100:00100000:2.0:1788839224.637298:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747096832:0@lo:400: 00000100:00100000:0.0:1788839224.637476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747096576:0@lo:400: 00000100:00100000:2.0:1788839224.645208:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839224.645401:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839224.645415:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747096960:0@lo:400: 00000100:00100000:2.0:1788839224.645468:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839224.645543:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096960 00000100:00100000:2.0:1788839224.645551:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096960 00000100:00100000:2.0:1788839224.645620:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839224.645629:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747096960:12345-0@lo:400: 00000100:00100000:2.0:1788839224.645689:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747096960:12345-0@lo:400: Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839224.645713:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788839224.645757:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3357f480 x1875733747096960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839224.645782:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747096960:0@lo:400: 00000100:00080000:2.0:1788839224.645808:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839224.645976:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839224.648893:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839224.648966:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747097088:0@lo:400: 00000100:00100000:2.0:1788839224.649182:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096576 00000100:00100000:2.0:1788839224.649191:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096576 00000100:00100000:2.0:1788839224.649252:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788839224.649263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747096576:12345-0@lo:400: 00000100:00100000:2.0:1788839224.649322:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747096576:12345-0@lo:400: Request processed in 61us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839224.649360:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788839224.654828:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747097216:0@lo:400: 00000100:00100000:1.0:1788839224.654901:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839224.654934:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097216 00000100:00100000:1.0:1788839224.654942:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097216 00000100:00100000:1.0:1788839224.655012:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839224.655021:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747097216:12345-0@lo:400: 00000100:00100000:1.0:1788839224.655090:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747097216:12345-0@lo:400: Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839224.655097:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788839224.655120:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788839224.655168:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3357f100 x1875733747097216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839224.655178:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788839224.655192:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747097216:0@lo:400: 00000100:00100000:0.0:1788839224.656716:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096832 00000100:00100000:0.0:1788839224.656729:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096832 00000100:00100000:0.0:1788839224.656806:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747096704 00000100:00100000:0.0:1788839224.656810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747096704 00000100:00100000:0.0:1788839224.656831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788839224.656842:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747096832:12345-0@lo:400: 00000100:00100000:0.0:1788839224.656917:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747096832:12345-0@lo:400: Request processed in 77us (11716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839224.656924:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788839224.656939:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788839224.656944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747096704:12345-0@lo:400: 00000100:00100000:0.0:1788839224.656974:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747096704:12345-0@lo:400: Request processed in 29us (11006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839224.656980:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839224.657229:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747096832:0@lo:400: 00000100:00100000:2.0:1788839224.657263:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839224.657313:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747096576:0@lo:400: 00000100:00100000:0.0:1788839224.657397:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097088 00000100:00100000:0.0:1788839224.657402:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097088 00000100:00100000:0.0:1788839224.657452:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839224.657460:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747097088:12345-0@lo:400: 00000100:00100000:0.0:1788839224.657497:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747097088:12345-0@lo:400: Request processed in 38us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839224.657504:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788839224.657585:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747097088:0@lo:400: 00000100:00080000:1.0:1788839224.659801:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839224.659863:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747096704:0@lo:400: 00010000:00010000:2.0:1788839224.703316:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839225.154676:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839225.154703:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747097344:0@lo:13: 00000100:00100000:1.0:1788839225.154796:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839225.155095:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097344 00000100:00100000:0.0:1788839225.155105:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097344 00000100:00100000:0.0:1788839225.155155:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839225.155165:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747097344:12345-0@lo:13: 00002000:00000024:0.0:1788839225.155191:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839225.155255:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747097344:12345-0@lo:13: Request processed in 91us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839225.155262:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788839225.155360:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8fb800 x1875733747097344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839225.155381:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747097344:0@lo:13: 00000001:00100000:0.0:1788839225.225464:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000100:00100000:3.0:1788839225.661660:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839225.661688:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747097472:0@lo:13: 00000100:00100000:3.0:1788839225.661761:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839225.662040:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097472 00000100:00100000:0.0:1788839225.662067:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097472 00000100:00100000:0.0:1788839225.662121:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839225.662131:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747097472:12345-0@lo:13: 00002000:00000024:0.0:1788839225.662166:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839225.662220:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747097472:12345-0@lo:13: Request processed in 90us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839225.662227:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788839225.662501:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3375dc00 x1875733747097472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839225.662523:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747097472:0@lo:13: 00010000:00010000:3.0:1788839225.725889:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839225.968497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839225.968625:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250432 00000100:00100000:0.0:1788839225.968636:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250432 00000100:00100000:0.0:1788839225.968718:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:0.0:1788839225.968731:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:5676:x1875733729250432:12345-192.168.201.9@tcp:41: 00000004:00000024:0.0:1788839225.968774:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788839225.968853:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:5676:x1875733729250432:12345-192.168.201.9@tcp:41: Request processed in 125us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839225.968860:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00080000:1.0:1788839225.969924:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839225.976326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839225.976573:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250560 00000100:00100000:0.0:1788839225.976590:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250560 00000100:00100000:0.0:1788839225.976697:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1788839225.976713:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07d32060-78a7-4509-9f5d-feb437ccdae6+5:5676:x1875733729250560:12345-192.168.201.9@tcp:13: 00002000:00000024:0.0:1788839225.976747:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839225.976845:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07d32060-78a7-4509-9f5d-feb437ccdae6+5:5676:x1875733729250560:12345-192.168.201.9@tcp:13: Request processed in 137us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839225.976851:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00080000:1.0:1788839225.977081:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839225.980358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839225.981233:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250688 00000100:00100000:1.0:1788839225.981248:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250688 00000100:00100000:1.0:1788839225.981343:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:1.0:1788839225.981355:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5676:x1875733729250688:12345-192.168.201.9@tcp:13: 00002000:00000024:1.0:1788839225.981403:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839225.981477:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07d32060-78a7-4509-9f5d-feb437ccdae6+6:5676:x1875733729250688:12345-192.168.201.9@tcp:13: Request processed in 125us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839225.981485:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00080000:2.0:1788839225.981713:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788839226.750707:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788839227.751166:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000001:00100000:1.0:1788839227.772184:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00010000:00010000:3.0:1788839227.773217:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839228.474213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839228.474269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839228.474303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839228.474329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839228.474366:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251072 00000100:00100000:2.0:1788839228.474376:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251072 00000100:00100000:2.0:1788839228.474431:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251200 00000100:00100000:2.0:1788839228.474435:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251200 00000100:00100000:2.0:1788839228.474454:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1788839228.474464:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729251072:12345-192.168.201.9@tcp:400: 00000100:00100000:2.0:1788839228.474532:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729251072:12345-192.168.201.9@tcp:400: Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839228.474539:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1788839228.474558:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1788839228.474565:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729251200:12345-192.168.201.9@tcp:400: 00000100:00100000:2.0:1788839228.474589:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729251200:12345-192.168.201.9@tcp:400: Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839228.474595:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00080000:2.0:1788839228.474611:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839228.474614:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839228.474723:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250816 00000100:00100000:1.0:1788839228.474728:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250816 00000100:00100000:1.0:1788839228.474764:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 129 00000100:00100000:1.0:1788839228.474771:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:2355:x1875733729250816:12345-192.168.201.9@tcp:400: 00000100:00100000:1.0:1788839228.474800:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:2355:x1875733729250816:12345-192.168.201.9@tcp:400: Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839228.474819:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 129 00000100:00100000:3.0:1788839228.475171:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729250944 00000100:00100000:3.0:1788839228.475176:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729250944 00000100:00100000:3.0:1788839228.475239:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:3.0:1788839228.475247:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729250944:12345-192.168.201.9@tcp:400: 00000100:00100000:3.0:1788839228.475292:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729250944:12345-192.168.201.9@tcp:400: Request processed in 46us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839228.475299:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00080000:1.0:1788839228.475705:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788839228.800428:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839228.852734:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788839229.757782:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747097856:0@lo:400: 00000100:00100000:1.0:1788839229.757936:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747097728:0@lo:400: 00000100:00100000:1.0:1788839229.758002:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839229.758287:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747098240:0@lo:400: 00000100:00100000:1.0:1788839229.758321:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839229.758359:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788839229.758365:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747097600:0@lo:400: 00000100:00100000:1.0:1788839229.758396:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839229.758419:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747098112:0@lo:400: 00000100:00100000:1.0:1788839229.758443:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839229.758475:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097728 00000100:00100000:1.0:1788839229.758482:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097728 00000100:00100000:1.0:1788839229.758523:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747098112 00000100:00100000:1.0:1788839229.758527:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747098112 00000100:00100000:1.0:1788839229.758554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839229.758564:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747097728:12345-0@lo:400: 00000100:00100000:1.0:1788839229.758620:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747097728:12345-0@lo:400: Request processed in 58us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839229.758629:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839229.758648:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839229.758654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747098112:12345-0@lo:400: 00000100:00100000:1.0:1788839229.758681:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747098112:12345-0@lo:400: Request processed in 27us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839229.758687:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839229.758721:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747098240 00000100:00100000:1.0:1788839229.758725:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747098240 00000100:00100000:1.0:1788839229.758753:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839229.758760:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747098240:12345-0@lo:400: 00000100:00100000:1.0:1788839229.758791:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747098240:12345-0@lo:400: Request processed in 32us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839229.758796:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788839229.758811:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839229.758815:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839229.759983:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097600 00000100:00100000:0.0:1788839229.759994:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097600 00000100:00100000:0.0:1788839229.760047:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788839229.760162:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747097600:12345-0@lo:400: 00000100:00100000:0.0:1788839229.760337:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747097600:12345-0@lo:400: Request processed in 249us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839229.760345:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788839229.760451:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839229.760485:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839229.760811:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097856 00000100:00100000:2.0:1788839229.760817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097856 00000100:00100000:2.0:1788839229.760852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839229.760860:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747097856:12345-0@lo:400: 00000100:00100000:2.0:1788839229.760915:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747097856:12345-0@lo:400: Request processed in 55us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839229.760923:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788839229.760948:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839229.761095:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747097984:0@lo:400: 00000100:00100000:3.0:1788839229.761137:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839229.761175:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747097856:0@lo:400: 00000100:00100000:2.0:1788839229.761251:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747097984 00000100:00100000:2.0:1788839229.761255:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747097984 00000100:00100000:2.0:1788839229.761290:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839229.761297:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747097984:12345-0@lo:400: 00000100:00100000:2.0:1788839229.761336:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747097984:12345-0@lo:400: Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839229.761342:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788839229.761357:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839229.761509:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747097600:0@lo:400: 00000100:00100000:0.0:1788839229.761524:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747098112:0@lo:400: 00000100:00100000:0.0:1788839229.761535:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747097728:0@lo:400: 00010000:00080000:0.0:1788839229.761550:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3357ed80 x1875733747098240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839229.761560:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747098240:0@lo:400: 00010000:00080000:3.0:1788839229.768415:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3357c380 x1875733747097984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839229.768430:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747097984:0@lo:400: 00010000:00010000:3.0:1788839229.821427:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839230.273046:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839230.273159:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747098368:0@lo:13: 00000100:00100000:2.0:1788839230.273363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839230.277705:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747098368 00000100:00100000:1.0:1788839230.277720:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747098368 00000100:00100000:1.0:1788839230.277773:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839230.277782:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747098368:12345-0@lo:13: 00002000:00000024:1.0:1788839230.277819:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839230.278043:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747098368:12345-0@lo:13: Request processed in 262us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839230.278277:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788839230.278367:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f77b80 x1875733747098368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839230.278387:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747098368:0@lo:13: 00000100:00100000:0.0:1788839230.781407:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839230.781436:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747098496:0@lo:13: 00000100:00100000:0.0:1788839230.781512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839230.781618:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747098496 00000100:00100000:2.0:1788839230.781627:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747098496 00000100:00100000:2.0:1788839230.781760:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839230.781770:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747098496:12345-0@lo:13: 00002000:00000024:2.0:1788839230.781926:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839230.782701:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747098496:12345-0@lo:13: Request processed in 931us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839230.782710:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788839230.788266:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33128e00 x1875733747098496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839230.788292:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747098496:0@lo:13: 00010000:00010000:0.0:1788839230.849525:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839231.870314:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788839232.235009:0:8453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea41acce0 20000000:00000080:2.0:1788839232.235036:0:8453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eb40650000 uarg=0000000000000000 20000000:01000000:2.0:1788839232.235402:0:8453:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788839232.235405:0:8453:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788839232.235408:0:8453:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788839232.235412:0:8453:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788839232.235417:0:8453:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788839232.235429:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788839232.235432:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788839232.235619:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788839232.235622:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788839232.236936:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788839232.237577:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788839232.237648:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788839232.237687:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788839232.237700:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788839232.237703:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788839232.239411:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788839232.239951:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788839232.240021:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788839232.240312:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788839232.240329:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788839232.240331:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788839232.241585:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788839232.254301:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788839232.254355:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788839232.254431:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788839232.254449:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788839232.254452:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788839232.258033:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788839232.258922:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788839232.258975:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788839232.259009:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1788839232.259027:0:8453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788839232.259047:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259085:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259104:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259112:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259118:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259125:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259131:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259138:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259149:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259157:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259165:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259226:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259251:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 9 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.259267:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747098624:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839232.259390:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259398:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 9 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.259406:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747098752:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839232.259435:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259443:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.259451:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747098880:0@lo:104: 00000100:00100000:1.0:1788839232.259486:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839232.259518:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747098880 00000100:00100000:1.0:1788839232.259526:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747098880 00000100:00100000:1.0:1788839232.259579:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839232.259589:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747098880:12345-0@lo:104: 00010000:00010000:1.0:1788839232.259602:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259649:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839232.259661:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747098880:12345-0@lo:104: Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.259668:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788839232.259699:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259707:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 18 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.259714:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099008:0@lo:104: 00000100:00100000:1.0:1788839232.259737:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839232.259758:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788839232.259767:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099008 00000100:00100000:1.0:1788839232.259770:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099008 00000100:00100000:1.0:1788839232.259787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839232.259792:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099008:12345-0@lo:104: 00010000:00010000:1.0:1788839232.259800:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259830:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788839232.259835:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099008:12345-0@lo:104: Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.259841:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788839232.259886:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.259895:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.259904:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099136:0@lo:104: 00000100:00100000:1.0:1788839232.259933:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839232.259952:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099136 00000100:00100000:1.0:1788839232.259955:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099136 00000100:00100000:1.0:1788839232.259972:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839232.259977:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099136:12345-0@lo:104: 00010000:00010000:1.0:1788839232.259985:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260010:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788839232.260015:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099136:12345-0@lo:104: Request processed in 38us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.260020:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788839232.260042:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260070:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 18 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260079:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099264:0@lo:104: 00000100:00100000:1.0:1788839232.260100:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839232.260118:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099264 00000100:00100000:1.0:1788839232.260122:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099264 00000100:00100000:1.0:1788839232.260137:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839232.260142:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099264:12345-0@lo:104: 00010000:00010000:1.0:1788839232.260149:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260173:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788839232.260178:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099264:12345-0@lo:104: Request processed in 36us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.260188:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1788839232.260227:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260235:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260244:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099392:0@lo:104: 00010000:00010000:0.0:1788839232.260257:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788839232.260264:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260272:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14528e00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839232.260276:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260278:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839232.260285:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839232.260293:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260296:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099392 00000100:00100000:1.0:1788839232.260299:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099392 10000000:01000000:0.0:1788839232.260299:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788839232.260314:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788839232.260319:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099392:12345-0@lo:104: 00010000:00010000:0.0:1788839232.260323:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260326:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260329:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839232.260345:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260350:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1788839232.260352:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14528e00/0x4b63896d6363fc15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fc1c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260355:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099392:12345-0@lo:104: Request processed in 36us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.260361:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788839232.260364:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788839232.260372:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260378:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839232.260381:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260383:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260388:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260391:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839232.260395:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260400:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099648:0@lo:104: 10000000:01000000:0.0:1788839232.260400:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839232.260413:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260419:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839232.260419:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839232.260424:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260430:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ee00/0x4b63896d6363fbeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260439:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1788839232.260442:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099648 00010000:00010000:0.0:1788839232.260443:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260445:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099648 00010000:00010000:0.0:1788839232.260448:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965000 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839232.260451:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260460:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788839232.260465:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099648:12345-0@lo:104: 00010000:00010000:0.0:1788839232.260467:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260472:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839232.260473:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839232.260479:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839232.260491:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260496:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1788839232.260497:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788839232.260501:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747099648:12345-0@lo:104: Request processed in 36us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.260506:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788839232.260511:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260517:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20965000/0x4b63896d6363fbcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbd6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260526:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788839232.260529:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260531:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260535:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839232.260538:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260539:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260545:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260547:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747100032:0@lo:104: 10000000:00010000:0.0:1788839232.260552:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839232.260562:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788839232.260567:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839232.260584:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100032 00010000:00010000:0.0:1788839232.260585:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260587:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100032 00010000:00010000:0.0:1788839232.260591:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839232.260596:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260602:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788839232.260604:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d6363fbc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbc8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260607:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747100032:12345-0@lo:104: 00010000:00010000:0.0:1788839232.260613:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788839232.260614:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260616:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260622:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964400 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839232.260625:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260631:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.260638:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:0.0:1788839232.260638:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260642:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:8453:x1875733747100032:12345-0@lo:104: Request processed in 36us (74us total) trans 0 rc 0/0 10000000:01000000:0.0:1788839232.260644:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839232.260655:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260656:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788839232.260660:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839232.260669:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260673:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5900 going to sleep for 11 seconds 00010000:00010000:0.0:1788839232.260675:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20964400/0x4b63896d6363fbb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fbba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260683:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839232.260685:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260690:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1a36c20) 00000100:00100000:1.0:1788839232.260692:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747098880:0@lo:104: 10000000:00010000:0.0:1788839232.260693:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260700:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099008:0@lo:104: 00010000:00010000:0.0:1788839232.260701:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260707:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099136:0@lo:104: 10000000:00010000:0.0:1788839232.260708:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260713:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099264:0@lo:104: 10000000:01000000:0.0:1788839232.260713:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788839232.260720:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099392:0@lo:104: 00010000:00010000:0.0:1788839232.260725:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.260726:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747099648:0@lo:104: 00010000:00010000:0.0:1788839232.260731:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788839232.260732:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747100032:0@lo:104: 00010000:00010000:0.0:1788839232.260735:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260741:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e000/0x4b63896d6363fb89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb90 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260748:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839232.260756:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260762:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14528400 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839232.260765:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260771:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839232.260777:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839232.260781:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839232.260793:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260798:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839232.260802:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260808:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14528400/0x4b63896d6363fb5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb66 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.260820:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839232.260822:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839232.260824:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839232.261079:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747099520:0@lo:103: 00000100:00100000:0.0:1788839232.261111:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839232.261139:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747100288:0@lo:103: 00000100:00100000:0.0:1788839232.261169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839232.261187:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788839232.261210:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747099776:0@lo:103: 00000100:00100000:0.0:1788839232.261232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839232.261250:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747100416:0@lo:103: 00000100:00100000:0.0:1788839232.261268:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839232.261293:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747099904:0@lo:103: 00000100:00100000:0.0:1788839232.261314:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839232.261323:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747100544:0@lo:103: 00000100:00100000:0.0:1788839232.261339:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839232.261349:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839232.261354:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747100160:0@lo:103: 00000100:00100000:0.0:1788839232.261374:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839232.261396:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099520 00000100:00100000:0.0:1788839232.261400:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099520 00010000:00010000:0.0:1788839232.261421:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839232.261437:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100288 00000100:00100000:0.0:1788839232.261439:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100288 00010000:00010000:0.0:1788839232.261450:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 20 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839232.261460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099776 00000100:00100000:0.0:1788839232.261463:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099776 00010000:00010000:0.0:1788839232.261473:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 21 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839232.261482:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100416 00000100:00100000:0.0:1788839232.261490:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100416 00010000:00010000:0.0:1788839232.261503:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 22 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839232.261514:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747099904 00000100:00100000:0.0:1788839232.261516:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747099904 00010000:00010000:0.0:1788839232.261526:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 23 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839232.261536:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100544 00000100:00100000:0.0:1788839232.261538:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100544 00010000:00010000:0.0:1788839232.261548:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 24 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839232.261557:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100160 00000100:00100000:0.0:1788839232.261559:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100160 00010000:00010000:0.0:1788839232.261568:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 25 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839232.261580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839232.261585:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839232.261585:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+25:3313:x1875733747099520:12345-0@lo:103: 00000100:00100000:1.0:1788839232.261591:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2841848a-c637-485f-b8f2-edd7dddc336d+25:3313:x1875733747100288:12345-0@lo:103: 00010000:00010000:0.0:1788839232.261595:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839232.261597:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839232.261600:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 25 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.261601:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 25 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.261609:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 25 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.261720:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839232.261729:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788839232.261737:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1788839232.261841:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839232.261849:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+25:3313:x1875733747099776:12345-0@lo:103: 00010000:00010000:3.0:1788839232.261857:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839232.261861:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 25 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.262247:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 25 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.262262:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6e800/0x4b63896d6363fbba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fbb3 expref: 25 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.262276:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839232.262326:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2841848a-c637-485f-b8f2-edd7dddc336d+24:3313:x1875733747100288:12345-0@lo:103: Request processed in 734us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.262332:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839232.262348:0:6711:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:3.0:1788839232.262431:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 23 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262442:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6f200/0x4b63896d6363fbf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fbeb expref: 23 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262452:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839232.262479:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+22:3313:x1875733747099776:12345-0@lo:103: Request processed in 631us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839232.262484:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839232.262497:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839232.262503:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+21:3313:x1875733747100416:12345-0@lo:103: 00010000:00010000:3.0:1788839232.262511:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839232.262516:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 21 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262524:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 21 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262533:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6800/0x4b63896d6363fb90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fb89 expref: 21 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262541:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839232.262563:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+20:3313:x1875733747100416:12345-0@lo:103: Request processed in 60us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839232.262569:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839232.262581:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839232.262587:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747099904:12345-0@lo:103: 00010000:00010000:3.0:1788839232.262599:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839232.262604:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262613:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262623:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6c00/0x4b63896d6363fbd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fbcf expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262631:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839232.262661:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+18:3311:x1875733747099904:12345-0@lo:103: Request processed in 74us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839232.262667:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839232.262680:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839232.262685:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+17:3311:x1875733747100544:12345-0@lo:103: 00010000:00010000:3.0:1788839232.262693:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839232.262697:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 17 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262705:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 17 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.262714:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6e200/0x4b63896d6363fb66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fb5f expref: 17 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.262717:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788839232.262723:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839232.262724:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2841848a-c637-485f-b8f2-edd7dddc336d+16:3311:x1875733747100160:12345-0@lo:103: 00010000:00010000:1.0:1788839232.262731:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839232.262735:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 16 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839232.262742:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+16:3311:x1875733747100544:12345-0@lo:103: Request processed in 58us (1402us total) trans 0 rc 0/0 00010000:00010000:1.0:1788839232.262743:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 16 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.262753:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6ec00/0x4b63896d6363fbc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fbc1 expref: 16 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839232.262756:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788839232.262761:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839232.262782:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2841848a-c637-485f-b8f2-edd7dddc336d+14:3311:x1875733747100160:12345-0@lo:103: Request processed in 59us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839232.262788:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839232.263044:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747099776:0@lo:103: 00000100:00100000:2.0:1788839232.263168:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747100416:0@lo:103: 00000100:00100000:2.0:1788839232.263177:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747100288:0@lo:103: 00010000:00010000:0.0:1788839232.263288:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6f600/0x4b63896d6363fc1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fc15 expref: 13 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.263298:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839232.263337:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+12:3313:x1875733747099520:12345-0@lo:103: Request processed in 1747us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839232.263345:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788839232.263401:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747099520:0@lo:103: 00000100:00100000:0.0:1788839232.263476:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747100160:0@lo:103: 00000100:00100000:0.0:1788839232.263484:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747099904:0@lo:103: 00000100:00100000:0.0:1788839232.263491:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747100544:0@lo:103: 00000100:00100000:2.0:1788839232.269735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839232.269769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839232.269813:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251328 00000100:00100000:3.0:1788839232.269823:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251328 00000100:00100000:0.0:1788839232.269832:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251456 00000100:00100000:0.0:1788839232.269836:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251456 00010000:00010000:3.0:1788839232.269860:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 11 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839232.269860:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 11 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839232.269898:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1788839232.269908:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7913c62c-0094-46f9-ba19-31fffcffa164+11:2357:x1875733729251328:12345-192.168.201.9@tcp:103: 00010000:00010000:3.0:1788839232.269922:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839232.269927:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 11 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839232.269928:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747098624:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839232.269938:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875733747098752:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839232.269939:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 11 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.269955:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6e400/0x4b63896d6363fc31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae0a expref: 11 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.269968:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839232.269981:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839232.270024:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7913c62c-0094-46f9-ba19-31fffcffa164+10:2357:x1875733729251328:12345-192.168.201.9@tcp:103: Request processed in 117us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839232.270032:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1788839232.270066:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:3.0:1788839232.270073:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7913c62c-0094-46f9-ba19-31fffcffa164+9:2357:x1875733729251456:12345-192.168.201.9@tcp:103: 00010000:00010000:3.0:1788839232.270082:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839232.270087:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 9 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270112:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 9 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270122:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae03 expref: 9 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270132:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270141:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270154:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270161:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270168:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270184:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270199:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ca00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839232.270203:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270212:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270243:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.270252:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839232.270278:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7913c62c-0094-46f9-ba19-31fffcffa164+8:2357:x1875733729251456:12345-192.168.201.9@tcp:103: Request processed in 205us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839232.270285:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00010000:00010000:1.0:1788839232.270292:0:8453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.270299:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839232.270310:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9ca00/0x4b63896d6363fc69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839232.894369:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788839233.470138:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788839233.470148:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb02e9b800 from 39 10000000:01000000:2.0:1788839233.470154:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839233.470231:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.470244:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.470256:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.470279:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747100672:0@lo:101: 00000100:00100000:2.0:1788839233.470348:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.470412:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.470493:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100672 00000100:00100000:3.0:1788839233.470502:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100672 00000100:00100000:3.0:1788839233.470561:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788839233.470572:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+12:5840:x1875733747100672:12345-0@lo:101: 00010000:00010000:3.0:1788839233.470587:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839233.470612:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fc70 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.470639:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fc70 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.470649:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fc70 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.470657:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14528000, rc 0) 00000100:00100000:3.0:1788839233.470712:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747100672:12345-0@lo:101: Request processed in 142us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.470719:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788839233.471092:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747100672:0@lo:101: 00010000:00010000:2.0:1788839233.471107:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.471117:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.471182:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747100800:0@lo:501: 00000100:00100000:2.0:1788839233.471210:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.471242:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.471345:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100800 00000100:00100000:0.0:1788839233.471350:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100800 00000100:00100000:0.0:1788839233.471386:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788839233.471394:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747100800:12345-0@lo:501: 00000100:00100000:0.0:1788839233.471671:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747100800:12345-0@lo:501: Request processed in 276us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.471677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788839233.471955:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747100800:0@lo:501: 00000100:00100000:2.0:1788839233.471985:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747100928:0@lo:503: 00000100:00100000:2.0:1788839233.472024:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.472067:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.472125:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747100928 00000100:00100000:3.0:1788839233.472130:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747100928 00000100:00100000:3.0:1788839233.472183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788839233.472190:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747100928:12345-0@lo:503: 00000100:00100000:3.0:1788839233.472350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747100928:12345-0@lo:503: Request processed in 160us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.472357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788839233.472433:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747100928:0@lo:503: 00000100:00100000:2.0:1788839233.473019:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8470:1875733747101056:0@lo:502: 00000100:00100000:2.0:1788839233.473084:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.473118:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.473187:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101056 00000100:00100000:0.0:1788839233.473193:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101056 00000100:00100000:0.0:1788839233.473228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788839233.473236:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:8470:x1875733747101056:12345-0@lo:502: 00000100:00100000:0.0:1788839233.473461:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:8470:x1875733747101056:12345-0@lo:502: Request processed in 226us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.473468:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788839233.474188:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8470:1875733747101056:0@lo:502: 00000100:00100000:2.0:1788839233.474251:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8470:1875733747101184:0@lo:502: 00000100:00100000:2.0:1788839233.474296:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.474436:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.479693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101184 00000100:00100000:0.0:1788839233.479890:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101184 00000100:00100000:0.0:1788839233.480048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788839233.480076:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:8470:x1875733747101184:12345-0@lo:502: 00000100:00100000:0.0:1788839233.480452:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:8470:x1875733747101184:12345-0@lo:502: Request processed in 379us (6155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.480460:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788839233.480574:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8470:1875733747101184:0@lo:502: 00000040:00080000:2.0:1788839233.480630:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788839233.483485:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788839233.483518:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788839233.483528:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.483538:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839233.483547:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788839233.483549:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788839233.483551:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788839233.483587:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.483593:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.483657:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839233.483683:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101312:0@lo:101: 00000100:00100000:3.0:1788839233.483903:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.483985:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.484066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101312 00000100:00100000:0.0:1788839233.484072:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101312 00000100:00100000:0.0:1788839233.484114:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788839233.484120:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+13:5840:x1875733747101312:12345-0@lo:101: 00010000:00010000:0.0:1788839233.484131:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839233.484142:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c7400/0x4b63896d6363fc85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fc7e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.484164:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c7400/0x4b63896d6363fc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fc7e expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.484185:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c7400/0x4b63896d6363fc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fc7e expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.484194:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7400, rc 0) 00000100:00100000:0.0:1788839233.484240:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747101312:12345-0@lo:101: Request processed in 119us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.484245:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788839233.484322:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101312:0@lo:101: 00010000:00010000:3.0:1788839233.484346:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.484353:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839233.484391:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101440:0@lo:501: 00000100:00100000:3.0:1788839233.484408:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.484429:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.484490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101440 00000100:00100000:0.0:1788839233.484493:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101440 00000100:00100000:0.0:1788839233.484506:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788839233.484509:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747101440:12345-0@lo:501: 00000100:00100000:0.0:1788839233.484897:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747101440:12345-0@lo:501: Request processed in 386us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.484910:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788839233.484977:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101440:0@lo:501: 00000100:00100000:3.0:1788839233.485002:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101568:0@lo:503: 00000100:00100000:3.0:1788839233.485040:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.485079:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839233.485151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101568 00000100:00100000:1.0:1788839233.485156:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101568 00000100:00100000:1.0:1788839233.485191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788839233.485198:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747101568:12345-0@lo:503: 00000100:00100000:1.0:1788839233.485434:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747101568:12345-0@lo:503: Request processed in 237us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839233.485439:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788839233.485556:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101568:0@lo:503: 00000100:00100000:1.0:1788839233.485964:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8471:1875733747101696:0@lo:502: 00000100:00100000:1.0:1788839233.485991:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839233.486041:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.486257:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101696 00000100:00100000:0.0:1788839233.486261:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101696 00000100:00100000:0.0:1788839233.486309:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788839233.486323:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:8471:x1875733747101696:12345-0@lo:502: 00000100:00100000:0.0:1788839233.486517:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+14:8471:x1875733747101696:12345-0@lo:502: Request processed in 201us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.486522:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788839233.491000:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8471:1875733747101696:0@lo:502: 00000020:01000000:3.0:1788839233.491069:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839233.491080:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839233.491082:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788839233.491086:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788839233.491117:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8471:1875733747101824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839233.491324:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.491365:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839233.491449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101824 00000100:00100000:2.0:1788839233.491456:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101824 00000100:00100000:2.0:1788839233.491507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788839233.491516:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:8471:x1875733747101824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839233.491730:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:8471:x1875733747101824:12345-0@lo:502:llog_process_th.0 Request processed in 215us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839233.491738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788839233.492677:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8471:1875733747101824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839233.492711:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839233.492719:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839233.492721:0:8471:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788839233.492732:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788839233.492922:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788839233.492937:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788839233.492946:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.492954:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839233.492961:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788839233.492963:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb3bf58000 from 39 10000000:01000000:2.0:1788839233.492965:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839233.492994:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.493004:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.493010:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.493024:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.493086:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.493113:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.493507:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747101952 00000100:00100000:3.0:1788839233.493512:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747101952 00000100:00100000:3.0:1788839233.493548:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788839233.493555:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+14:5840:x1875733747101952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839233.493567:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839233.493577:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14529e00/0x4b63896d6363fc93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fc8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.493596:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14529e00/0x4b63896d6363fc93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fc8c expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.493606:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14529e00/0x4b63896d6363fc93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fc8c expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.493615:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14529e00, rc 0) 00000100:00100000:3.0:1788839233.493665:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747101952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.493671:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788839233.494426:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747101952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839233.494440:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.494448:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.494510:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.494546:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.494584:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.494659:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102080 00000100:00100000:3.0:1788839233.494664:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102080 00000100:00100000:3.0:1788839233.494700:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788839233.494708:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747102080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.494991:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747102080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.494999:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788839233.495511:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.495543:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.495575:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.495640:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.499057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102208 00000100:00100000:0.0:1788839233.499071:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102208 00000100:00100000:0.0:1788839233.499133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788839233.499140:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747102208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839233.499403:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747102208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (3827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.499409:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788839233.501370:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.502084:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8472:1875733747102336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839233.502158:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.502206:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.502306:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102336 00000100:00100000:0.0:1788839233.502319:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102336 00000100:00100000:0.0:1788839233.502358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788839233.502366:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:8472:x1875733747102336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839233.502567:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:8472:x1875733747102336:12345-0@lo:502:llog_process_th.0 Request processed in 201us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.502572:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788839233.502882:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8472:1875733747102336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839233.502932:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8472:1875733747102464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839233.502957:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.502974:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.503305:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102464 00000100:00100000:0.0:1788839233.503310:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102464 00000100:00100000:0.0:1788839233.503364:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788839233.503370:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:8472:x1875733747102464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839233.503498:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+15:8472:x1875733747102464:12345-0@lo:502:llog_process_th.0 Request processed in 129us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.503504:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788839233.503566:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8472:1875733747102464:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788839233.503583:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788839233.504009:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788839233.504031:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788839233.504042:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.504092:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839233.504101:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788839233.504103:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788839233.504106:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788839233.504144:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.504152:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.504161:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839233.504186:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.504224:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.504256:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839233.504307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102592 00000100:00100000:2.0:1788839233.504310:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102592 00000100:00100000:2.0:1788839233.504336:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788839233.504341:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+15:5840:x1875733747102592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839233.504348:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839233.504357:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20965800/0x4b63896d6363fca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fc9a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.504373:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965800/0x4b63896d6363fca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fc9a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.504380:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20965800/0x4b63896d6363fca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fc9a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.504386:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965800, rc 0) 00000100:00100000:2.0:1788839233.504415:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747102592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839233.504419:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788839233.504510:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839233.504520:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.504525:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839233.504558:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.504576:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.504602:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839233.504669:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102720 00000100:00100000:2.0:1788839233.504673:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102720 00000100:00100000:2.0:1788839233.504685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788839233.504689:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747102720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.504904:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747102720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839233.504910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788839233.505027:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.505046:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.505097:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.505108:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06160f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839233.505547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102848 00000100:00100000:2.0:1788839233.505553:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102848 00000100:00100000:2.0:1788839233.505572:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788839233.505576:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747102848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.505761:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747102848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839233.505768:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788839233.506067:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747102848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.506728:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8473:1875733747102976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839233.506776:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.506847:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb061606c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839233.506882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747102976 00000100:00100000:2.0:1788839233.506886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747102976 00000100:00100000:2.0:1788839233.506942:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788839233.506947:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:8473:x1875733747102976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839233.507186:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:8473:x1875733747102976:12345-0@lo:502:llog_process_th.0 Request processed in 238us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839233.507193:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788839233.507251:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8473:1875733747102976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839233.507273:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839233.507280:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839233.507282:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788839233.507285:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788839233.507299:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8473:1875733747103104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839233.507333:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.507526:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb101c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.507592:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747103104 00000100:00100000:0.0:1788839233.507596:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747103104 00000100:00100000:0.0:1788839233.507617:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788839233.507623:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:8473:x1875733747103104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839233.510353:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:8473:x1875733747103104:12345-0@lo:502:llog_process_th.0 Request processed in 2720us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.510364:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788839233.510652:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8473:1875733747103104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839233.510690:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839233.510706:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839233.510709:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788839233.510713:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788839233.510869:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788839233.510883:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788839233.510893:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.510901:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839233.510919:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788839233.510921:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb02d49000 from 39 10000000:01000000:2.0:1788839233.510923:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839233.510950:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.510956:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.510962:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.510977:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.511017:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.511040:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839233.511126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747103232 00000100:00100000:0.0:1788839233.511132:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747103232 00000100:00100000:0.0:1788839233.511167:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788839233.511186:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747103232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839233.511199:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839233.511211:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6600/0x4b63896d6363fcaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fca8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.517608:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6600/0x4b63896d6363fcaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fca8 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.517633:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6600/0x4b63896d6363fcaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fca8 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.517646:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6600, rc 0) 00000100:00100000:0.0:1788839233.517771:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747103232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6583us (6748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.517799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788839233.518216:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839233.518235:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.518243:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839233.518307:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839233.518348:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839233.518406:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839233.518759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747103360 00000100:00100000:2.0:1788839233.518767:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747103360 00000100:00100000:2.0:1788839233.518850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788839233.518861:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747103360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.519123:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747103360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839233.519128:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788839233.519205:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.519242:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.519274:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.519490:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb061606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839233.519550:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747103488 00000100:00100000:1.0:1788839233.519553:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747103488 00000100:00100000:1.0:1788839233.519571:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788839233.519575:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747103488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839233.519712:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747103488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839233.519726:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788839233.519819:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.520099:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8474:1875733747103616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839233.520125:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.520140:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb101c8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839233.520191:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747103616 00000100:00100000:1.0:1788839233.520195:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747103616 00000100:00100000:1.0:1788839233.520214:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788839233.520221:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8474:x1875733747103616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839233.520404:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8474:x1875733747103616:12345-0@lo:502:llog_process_th.0 Request processed in 183us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839233.520411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788839233.522122:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8474:1875733747103616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839233.522206:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8474:1875733747103744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839233.522260:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839233.522299:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb061606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839233.522364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747103744 00000100:00100000:1.0:1788839233.522369:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747103744 00000100:00100000:1.0:1788839233.522395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788839233.522400:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8474:x1875733747103744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839233.522571:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8474:x1875733747103744:12345-0@lo:502:llog_process_th.0 Request processed in 170us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839233.522576:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788839233.522656:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8474:1875733747103744:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788839233.522673:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788839233.522826:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788839233.522847:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839233.522858:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.522868:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839233.522876:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788839233.522877:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788839233.522879:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788839233.522900:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.522910:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.522916:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839233.522925:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839233.522946:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839233.522970:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.523007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747103872 00000100:00100000:3.0:1788839233.523011:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747103872 00000100:00100000:3.0:1788839233.523024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788839233.523028:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747103872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839233.523034:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839233.523044:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14528400/0x4b63896d6363fcbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fcb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.523081:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14528400/0x4b63896d6363fcbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fcb6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.523088:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14528400/0x4b63896d6363fcbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fcb6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.523094:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14528400, rc 0) 00000100:00100000:3.0:1788839233.523118:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747103872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.523122:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788839233.523187:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747103872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839233.523199:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.523208:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839233.523245:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839233.523261:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839233.523282:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.523316:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104000 00000100:00100000:3.0:1788839233.523319:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104000 00000100:00100000:3.0:1788839233.523331:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788839233.523335:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747104000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.523503:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747104000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.523507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788839233.523581:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839233.523599:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839233.523630:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839233.523651:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.523688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104128 00000100:00100000:3.0:1788839233.523691:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104128 00000100:00100000:3.0:1788839233.523707:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788839233.523712:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747104128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.523848:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747104128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.523855:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788839233.523911:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839233.528464:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8475:1875733747104256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839233.528540:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839233.528579:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.528633:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104256 00000100:00100000:3.0:1788839233.528640:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104256 00000100:00100000:3.0:1788839233.528675:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788839233.528682:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:8475:x1875733747104256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839233.528917:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:8475:x1875733747104256:12345-0@lo:502:llog_process_th.0 Request processed in 235us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.528923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788839233.529759:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8475:1875733747104256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839233.529810:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839233.529820:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839233.529822:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788839233.529827:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788839233.529854:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8475:1875733747104384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839233.529896:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839233.529917:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839233.530012:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104384 00000100:00100000:2.0:1788839233.530019:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104384 00000100:00100000:2.0:1788839233.530067:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788839233.530074:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+18:8475:x1875733747104384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839233.530261:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+18:8475:x1875733747104384:12345-0@lo:502:llog_process_th.0 Request processed in 188us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839233.530272:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788839233.530352:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8475:1875733747104384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839233.530366:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839233.530369:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839233.530371:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788839233.530373:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788839233.530522:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788839233.530538:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788839233.530547:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.530555:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839233.530562:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788839233.530564:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eb09e08000 from 1 10000000:01000000:2.0:1788839233.530566:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788839233.530586:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.530591:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.530597:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.530610:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.530639:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.530669:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.530906:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104512 00000100:00100000:3.0:1788839233.530909:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104512 00000100:00100000:3.0:1788839233.530926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788839233.530936:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747104512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839233.530945:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839233.530955:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14528e00/0x4b63896d6363fccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fcc4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.530974:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14528e00/0x4b63896d6363fccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fcc4 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.530982:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14528e00/0x4b63896d6363fccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fcc4 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839233.530988:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14528e00, rc 0) 00000100:00100000:3.0:1788839233.531020:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747104512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839233.531025:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788839233.531089:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839233.531098:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.531113:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.531147:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839233.531182:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839233.531204:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839233.531246:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104640 00000100:00100000:3.0:1788839233.531250:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104640 00000100:00100000:3.0:1788839233.531271:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788839233.531275:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747104640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839233.531445:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747104640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (262us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788839233.531450:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788839233.531621:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747104640:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788839233.531640:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788839233.531646:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839233.531653:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839233.601791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839233.602348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839233.602380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839233.602461:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251584 00000100:00100000:2.0:1788839233.602468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839233.602471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251584 00000100:00100000:3.0:1788839233.602513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251712 00000100:00100000:3.0:1788839233.602517:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251712 00000100:00100000:0.0:1788839233.602525:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 163 00000100:00100000:0.0:1788839233.602534:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+8:2357:x1875733729251584:12345-192.168.201.9@tcp:400: 00000100:00100000:3.0:1788839233.602558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:3.0:1788839233.602564:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729251712:12345-192.168.201.9@tcp:400: 00000100:00100000:3.0:1788839233.602608:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729251712:12345-192.168.201.9@tcp:400: Request processed in 43us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.602608:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+8:2357:x1875733729251584:12345-192.168.201.9@tcp:400: Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.602615:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 163 00000100:00100000:3.0:1788839233.602625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00080000:3.0:1788839233.602642:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839233.604123:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251968 00000100:00100000:1.0:1788839233.604136:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251968 00000100:00100000:1.0:1788839233.604217:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729251840 00000100:00100000:1.0:1788839233.604222:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729251840 00000100:00100000:1.0:1788839233.604252:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1788839233.604262:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729251968:12345-192.168.201.9@tcp:400: 00000100:00100000:1.0:1788839233.604335:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729251968:12345-192.168.201.9@tcp:400: Request processed in 75us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839233.604342:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1788839233.604361:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:1.0:1788839233.604368:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729251840:12345-192.168.201.9@tcp:400: 00000100:00080000:2.0:1788839233.604467:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839233.604472:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839233.604684:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729251840:12345-192.168.201.9@tcp:400: Request processed in 316us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839233.604771:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839233.656524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839233.669333:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252096 00000100:00100000:1.0:1788839233.669350:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252096 00000100:00100000:1.0:1788839233.669431:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:1.0:1788839233.669443:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+8:5597:x1875733729252096:12345-192.168.201.9@tcp:101: 00010000:00010000:1.0:1788839233.669462:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839233.669484:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9d200/0x4b63896d6363fcd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae6c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.669521:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9d200/0x4b63896d6363fcd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae6c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.669546:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9d200/0x4b63896d6363fcd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae6c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839233.669556:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d200, rc 0) 00000100:00100000:1.0:1788839233.669644:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+9:5597:x1875733729252096:12345-192.168.201.9@tcp:101: Request processed in 203us (13131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839233.669651:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:2.0:1788839233.673462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839233.675484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252224 00000100:00100000:0.0:1788839233.675499:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252224 00000100:00100000:0.0:1788839233.675986:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:0.0:1788839233.675999:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+9:5597:x1875733729252224:12345-192.168.201.9@tcp:501: 00000100:00100000:0.0:1788839233.676590:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+9:5597:x1875733729252224:12345-192.168.201.9@tcp:501: Request processed in 592us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.676600:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:2.0:1788839233.680713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839233.681314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252352 00000100:00100000:0.0:1788839233.681325:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252352 00000100:00100000:0.0:1788839233.681394:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:0.0:1788839233.681404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+9:5597:x1875733729252352:12345-192.168.201.9@tcp:503: 00000100:00100000:0.0:1788839233.681650:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+9:5597:x1875733729252352:12345-192.168.201.9@tcp:503: Request processed in 247us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.681658:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:2.0:1788839233.688990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839233.689551:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252480 00000100:00100000:0.0:1788839233.689562:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252480 00000100:00100000:0.0:1788839233.689642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:0.0:1788839233.689650:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+9:6070:x1875733729252480:12345-192.168.201.9@tcp:502: 00000100:00100000:0.0:1788839233.689960:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+9:6070:x1875733729252480:12345-192.168.201.9@tcp:502: Request processed in 305us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.689969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:2.0:1788839233.693490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839233.693625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252608 00000100:00100000:1.0:1788839233.693638:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252608 00000100:00100000:1.0:1788839233.693694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:1.0:1788839233.693704:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+9:6070:x1875733729252608:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788839233.694452:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+9:6070:x1875733729252608:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 745us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.694463:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:2.0:1788839233.698450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839233.699719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252736 00000100:00100000:0.0:1788839233.699732:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252736 00000100:00100000:0.0:1788839233.700003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:0.0:1788839233.700015:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+9:5597:x1875733729252736:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839233.700033:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839233.700070:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6000/0x4b63896d6363fcd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae73 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.700102:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6000/0x4b63896d6363fcd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae73 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.700113:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6000/0x4b63896d6363fcd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae73 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839233.700122:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6000, rc 0) 00000100:00100000:0.0:1788839233.700200:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729252736:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 187us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839233.700207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:2.0:1788839233.702682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839233.702782:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252864 00000100:00100000:0.0:1788839233.702792:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252864 00000100:00100000:0.0:1788839233.702956:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 170 00000100:00100000:0.0:1788839233.702985:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729252864:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839233.703685:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729252864:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 700us (1009us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839233.703694:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 170 00010000:00010000:3.0:1788839233.918187:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839234.877520:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747105024:0@lo:400:kworker.0 00000100:00100000:1.0:1788839234.877594:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839234.877662:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788839234.877681:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747104896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839234.877706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839234.877720:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747105408:0@lo:400:kworker.0 00000100:00100000:1.0:1788839234.877742:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839234.877780:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747105024 00000100:00100000:1.0:1788839234.877787:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747105024 00000100:00100000:1.0:1788839234.877831:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104896 00000100:00100000:1.0:1788839234.877834:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104896 00000100:00100000:2.0:1788839234.877984:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747105152:0@lo:400:kworker.0 00000100:00100000:2.0:1788839234.878011:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839234.878031:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788839234.878036:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747104768:0@lo:400:kworker.0 00000100:00100000:2.0:1788839234.878084:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839234.878105:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747105280:0@lo:400:kworker.0 00000100:00100000:2.0:1788839234.878126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839234.878199:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747105280 00000100:00100000:3.0:1788839234.878203:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747105280 00000100:00100000:1.0:1788839234.878243:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788839234.878254:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747105024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839234.878307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747105024:12345-0@lo:400:kworker.0 Request processed in 55us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839234.878360:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747105024:0@lo:400:kworker.0 00000100:00100000:0.0:1788839234.878472:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747104768 00000100:00100000:0.0:1788839234.878476:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747104768 00000100:00100000:0.0:1788839234.878516:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788839234.878524:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747104768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839234.878561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747104768:12345-0@lo:400:kworker.0 Request processed in 38us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839234.878567:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788839234.878603:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747104768:0@lo:400:kworker.0 00000100:00080000:0.0:1788839234.878632:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839234.878644:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747105408 00000100:00100000:0.0:1788839234.878648:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747105408 00000100:00100000:0.0:1788839234.878673:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747105152 00000100:00100000:0.0:1788839234.878675:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747105152 00000100:00100000:0.0:1788839234.878688:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839234.878694:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747105408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839234.878726:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747105408:12345-0@lo:400:kworker.0 Request processed in 32us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839234.878731:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839234.878742:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839234.878748:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747105152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839234.878779:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747105152:12345-0@lo:400:kworker.0 Request processed in 31us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839234.878796:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788839234.878810:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839234.878813:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788839234.878829:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f74000 x1875733747105152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839234.878841:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747105152:0@lo:400:kworker.0 00010000:00080000:0.0:1788839234.878878:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f75180 x1875733747105408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839234.878886:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747105408:0@lo:400:kworker.0 00000100:00100000:0.0:1788839234.878917:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788839234.878924:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788839234.879296:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788839234.879306:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839234.879313:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747104896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839234.879348:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747104896:12345-0@lo:400:kworker.0 Request processed in 36us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839234.879354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839234.879365:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788839234.879370:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788839234.879375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747105280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839234.879451:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747105280:12345-0@lo:400:kworker.0 Request processed in 74us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839234.879457:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839234.879637:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747104896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839234.879822:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839234.880766:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747105280:0@lo:400:kworker.0 00010000:00010000:3.0:1788839234.941374:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839235.390084:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747105536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839235.390169:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839235.390271:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747105536 00000100:00100000:1.0:1788839235.390281:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747105536 00000100:00100000:1.0:1788839235.390330:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839235.390341:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747105536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839235.390374:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839235.390420:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747105536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839235.390426:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788839235.390454:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f74380 x1875733747105536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839235.390474:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747105536:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788839235.494723:0:8513:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1a80cf60 20000000:00000080:3.0:1788839235.494743:0:8513:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eb05b92000 uarg=0000000000000000 20000000:01000000:3.0:1788839235.494909:0:8513:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788839235.494915:0:8513:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788839235.494920:0:8513:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788839235.496987:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788839235.497185:0:8513:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788839235.505031:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788839235.505295:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788839235.505351:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788839235.505371:0:8513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788839235.505390:0:8513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505421:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb00030a00/0x4b63896d6363fa55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505429:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505436:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505446:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505454:0:8513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505501:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505519:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 9 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.505534:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747105664:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839235.505652:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.505661:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 18 pid: 5837 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.505671:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747105792:0@lo:104: 00000100:00100000:0.0:1788839235.506369:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839235.508089:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.508109:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 18 pid: 5836 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.508123:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747105920:0@lo:104: 00000100:00100000:0.0:1788839235.508207:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839235.508245:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb00030a00/0x4b63896d6363fa55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.508254:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb00030a00/0x4b63896d6363fa55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 18 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.508262:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747106048:0@lo:104: 00000100:00100000:0.0:1788839235.508279:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33079d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839235.508370:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788839235.508389:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839235.508403:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747105792 00000100:00100000:3.0:1788839235.508409:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747105792 00000100:00100000:3.0:1788839235.508462:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747105920 00000100:00100000:3.0:1788839235.508465:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747105920 00000100:00100000:3.0:1788839235.508474:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106048 00000100:00100000:3.0:1788839235.508477:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106048 00000100:00100000:3.0:1788839235.508489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839235.508498:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+5:8513:x1875733747105792:12345-0@lo:104: 00010000:00010000:3.0:1788839235.508512:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508565:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839235.508571:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+5:8513:x1875733747105792:12345-0@lo:104: Request processed in 74us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.508577:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839235.508593:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839235.508599:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40623050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+4:8513:x1875733747105920:12345-0@lo:104: 00010000:00010000:3.0:1788839235.508606:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508637:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788839235.508642:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40623050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+4:8513:x1875733747105920:12345-0@lo:104: Request processed in 44us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.508647:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839235.508680:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839235.508686:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:8513:x1875733747106048:12345-0@lo:104: 00010000:00010000:3.0:1788839235.508696:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508721:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788839235.508732:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:8513:x1875733747106048:12345-0@lo:104: Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.508738:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788839235.508756:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788839235.508763:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508771:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6fc00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839235.508776:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508785:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839235.508791:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839235.508796:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839235.508822:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508829:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839235.508848:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d6363fb7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fb82 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508867:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839235.508870:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508886:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529800 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839235.508890:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508897:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839235.508903:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839235.508907:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839235.508920:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508926:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839235.508932:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508938:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14529800/0x4b63896d6363fab0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fab7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508947:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839235.508949:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508955:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e600 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839235.508958:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.508975:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839235.508982:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839235.508988:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839235.509001:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509007:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839235.509022:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509029:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e600/0x4b63896d6363fa4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fa55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509042:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839235.509043:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839235.509045:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839235.509073:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839235.509085:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747106304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839235.509115:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839235.509158:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839235.509164:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747106176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839235.509189:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839235.509211:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839235.509218:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747106432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839235.509246:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839235.509272:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106304 00000100:00100000:3.0:1788839235.509276:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106304 00010000:00010000:3.0:1788839235.509293:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 19 pid: 5836 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839235.509310:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106176 00000100:00100000:3.0:1788839235.509313:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106176 00010000:00010000:3.0:1788839235.509321:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 20 pid: 5837 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839235.509333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106432 00000100:00100000:3.0:1788839235.509335:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106432 00010000:00010000:3.0:1788839235.509343:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb00030a00/0x4b63896d6363fa55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 21 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839235.509352:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839235.509358:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+21:3312:x1875733747106304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839235.509367:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839235.509371:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 21 pid: 5836 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509379:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 21 pid: 5836 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509394:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839235.509418:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+21:3312:x1875733747106304:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.509424:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839235.509435:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839235.509448:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+20:3312:x1875733747106176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839235.509455:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839235.509460:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 20 pid: 5837 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509467:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 20 pid: 5837 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509477:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839235.509499:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+20:3312:x1875733747106176:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.509505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839235.509517:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839235.509522:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747106432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839235.509529:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839235.509533:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb00030a00/0x4b63896d6363fa55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 19 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509541:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb00030a00/0x4b63896d6363fa55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 19 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.509550:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839235.509577:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747106432:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.509583:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839235.509621:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747106432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839235.509642:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747106176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839235.509650:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747106304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839235.510641:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fb82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fb7b expref: 18 pid: 5837 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.510654:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747105792:0@lo:104: 00010000:00010000:0.0:1788839235.510665:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb00030000/0x4b63896d6363fab7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fab0 expref: 17 pid: 5836 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.510675:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747105920:0@lo:104: 00010000:00010000:0.0:1788839235.510685:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb00030a00/0x4b63896d6363fa55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fa4e expref: 16 pid: 5838 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.510693:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747106048:0@lo:104: 00000100:00100000:2.0:1788839235.524455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839235.526015:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729252992 00000100:00100000:3.0:1788839235.526028:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729252992 00010000:00010000:3.0:1788839235.526103:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 10 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839235.526153:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:3.0:1788839235.526163:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729252992:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839235.526181:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839235.526187:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 10 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526201:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 10 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526222:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526231:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526247:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526254:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526261:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526267:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526288:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839235.526293:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526302:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526312:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839235.526322:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839235.526382:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729252992:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 220us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.526389:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00010000:00010000:0.0:1788839235.528230:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6400/0x4b63896d6363fc3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae3b expref: 9 pid: 5838 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839235.528251:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875733747105664:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839235.528291:0:8513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.528303:0:8513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.528309:0:8513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839235.528314:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c7e00/0x4b63896d6363fce0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839235.903104:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747106560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839235.903200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839235.903285:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106560 00000100:00100000:3.0:1788839235.903293:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106560 00000100:00100000:3.0:1788839235.903340:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839235.903350:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747106560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839235.903386:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839235.903437:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747106560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839235.903444:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788839235.903488:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3312ad80 x1875733747106560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839235.903507:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747106560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839235.965213:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839236.601372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839236.601862:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729253120 00000100:00100000:1.0:1788839236.601873:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729253120 00000100:00100000:1.0:1788839236.601926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 172 00000100:00100000:1.0:1788839236.601936:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+9:5597:x1875733729253120:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839236.601953:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839236.601972:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839236.602014:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839236.602027:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839236.602036:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9dc00, rc 0) 00000100:00100000:1.0:1788839236.602124:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729253120:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 180us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839236.602133:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 172 00000100:00100000:2.0:1788839236.605649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839236.605811:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729253248 00000100:00100000:3.0:1788839236.605820:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729253248 00000100:00100000:3.0:1788839236.605862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:3.0:1788839236.605870:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729253248:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839236.606158:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729253248:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 286us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839236.606165:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:3.0:1788839236.609036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839236.610997:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729253376 00000100:00100000:2.0:1788839236.611012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729253376 00000100:00100000:2.0:1788839236.611684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:2.0:1788839236.611697:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729253376:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839236.611927:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:5597:x1875733729253376:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 233us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839236.611935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:2.0:1788839236.624735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839236.627745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729253504 00000100:00100000:3.0:1788839236.627761:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729253504 00000100:00100000:3.0:1788839236.627960:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:3.0:1788839236.627973:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:6127:x1875733729253504:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839236.628253:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:6127:x1875733729253504:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 283us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839236.628262:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:0.0:1788839236.635016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839236.635791:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729253632 00000100:00100000:2.0:1788839236.635803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729253632 00000100:00100000:2.0:1788839236.635861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:2.0:1788839236.635873:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:6127:x1875733729253632:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839236.636662:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:6127:x1875733729253632:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 788us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839236.636680:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 176 00010000:00010000:3.0:1788839236.990148:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788839237.117289:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839237.117299:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02e9b800 from 4 10000000:01000000:2.0:1788839237.117305:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839237.117366:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.117378:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.117390:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839237.117417:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747106688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.117496:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.117560:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839237.117714:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106688 00000100:00100000:3.0:1788839237.117722:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106688 00000100:00100000:3.0:1788839237.117773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788839237.117782:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747106688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839237.117797:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839237.117812:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fcee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.117859:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fcee expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.117871:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fcee expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.117881:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14529800, rc 0) 00000100:00100000:3.0:1788839237.118260:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747106688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 478us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839237.118268:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788839237.118601:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747106688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839237.118621:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839237.118631:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839237.118764:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747106816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839237.118803:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839237.118877:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33079840 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.118921:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106816 00000100:00100000:2.0:1788839237.118926:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106816 00000100:00100000:2.0:1788839237.118996:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788839237.119005:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747106816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.119303:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747106816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.119311:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788839237.119370:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747106816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839237.119414:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747106944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839237.119454:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839237.119636:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33079840 going to sleep for 11 seconds 00000100:00100000:1.0:1788839237.119735:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747106944 00000100:00100000:1.0:1788839237.119740:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747106944 00000100:00100000:1.0:1788839237.119765:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788839237.119774:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747106944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839237.119926:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747106944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839237.119934:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788839237.120017:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747106944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839237.120515:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8582:1875733747107072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839237.120557:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839237.120590:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839237.120651:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107072 00000100:00100000:1.0:1788839237.120656:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107072 00000100:00100000:1.0:1788839237.120679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788839237.120685:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8582:x1875733747107072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839237.120884:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8582:x1875733747107072:12345-0@lo:502:llog_process_th.0 Request processed in 198us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839237.120891:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788839237.121206:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8582:1875733747107072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839237.121232:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839237.121242:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839237.121245:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788839237.121251:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb02e9b800 00000020:00000080:0.0:1788839237.121253:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788839237.121380:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8582:1875733747107200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839237.121420:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839237.121455:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.121510:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107200 00000100:00100000:2.0:1788839237.121515:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107200 00000100:00100000:2.0:1788839237.121549:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788839237.121557:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8582:x1875733747107200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.121709:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:8582:x1875733747107200:12345-0@lo:502:llog_process_th.0 Request processed in 152us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.121722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788839237.121939:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8582:1875733747107200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839237.121959:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839237.121963:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839237.121965:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788839237.121968:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788839237.122184:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788839237.122201:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839237.122212:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.122222:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839237.122232:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788839237.122235:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb3bf58000 from 4 10000000:01000000:3.0:1788839237.122237:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839237.122262:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.122270:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.122278:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839237.122302:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839237.122335:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839237.122360:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.122456:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107328 00000100:00100000:2.0:1788839237.122461:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107328 00000100:00100000:2.0:1788839237.122491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788839237.122499:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747107328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839237.122520:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839237.122533:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fcfc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.122556:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.122566:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.122576:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964e00, rc 0) 00000100:00100000:2.0:1788839237.122618:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747107328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.122625:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788839237.122718:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839237.122732:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.122742:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839237.122793:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839237.122819:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839237.122841:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.122940:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107456 00000100:00100000:2.0:1788839237.122944:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107456 00000100:00100000:2.0:1788839237.122974:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788839237.122981:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747107456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.123264:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747107456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.123271:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788839237.123303:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.123337:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.123370:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.123385:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.123395:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107584 00000100:00100000:2.0:1788839237.123399:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107584 00000100:00100000:2.0:1788839237.123416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788839237.123423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747107584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.123548:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747107584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.123555:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788839237.123588:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.123768:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8583:1875733747107712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.123800:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.123817:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107712 00000100:00100000:2.0:1788839237.123821:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107712 00000100:00100000:2.0:1788839237.123838:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788839237.123844:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:8583:x1875733747107712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.123954:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:8583:x1875733747107712:12345-0@lo:502:llog_process_th.0 Request processed in 109us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.123960:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788839237.123988:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.124001:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8583:1875733747107712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839237.124021:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839237.124030:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839237.124037:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788839237.124043:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb3bf58000 00000020:00000080:2.0:1788839237.124046:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788839237.128850:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8583:1875733747107840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.128936:0:8583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.128979:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.134240:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107840 00000100:00100000:2.0:1788839237.134256:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107840 00000100:00100000:2.0:1788839237.134316:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788839237.134328:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:8583:x1875733747107840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.134601:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:8583:x1875733747107840:12345-0@lo:502:llog_process_th.0 Request processed in 275us (5663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.134609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788839237.134673:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8583:1875733747107840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839237.134721:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839237.134730:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839237.134732:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788839237.134736:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788839237.134797:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788839237.134818:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839237.134828:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.134840:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839237.134851:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839237.134854:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02d49000 from 4 10000000:01000000:2.0:1788839237.134857:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839237.134891:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.134899:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.134909:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839237.134928:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.134961:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.134991:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839237.135340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747107968 00000100:00100000:3.0:1788839237.135345:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747107968 00000100:00100000:3.0:1788839237.135375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788839237.135382:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747107968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839237.135391:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839237.135404:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fd0a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.135426:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.135437:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.135458:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14529200, rc 0) 00000100:00100000:3.0:1788839237.135498:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747107968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839237.135505:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788839237.135540:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747107968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839237.135552:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839237.135561:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839237.135612:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747108096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839237.135638:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839237.135652:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839237.135664:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108096 00000100:00100000:3.0:1788839237.135668:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108096 00000100:00100000:3.0:1788839237.135684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788839237.136006:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747108096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839237.136351:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747108096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.136412:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747108096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.136445:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747108224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.136486:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.136497:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.141352:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108224 00000100:00100000:2.0:1788839237.141368:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108224 00000100:00100000:3.0:1788839237.147804:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788839237.153830:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788839237.153854:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747108224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.154190:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747108224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 345us (17703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.154198:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788839237.154260:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747108224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839237.154494:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8587:1875733747108352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.154541:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.154581:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.169330:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108352 00000100:00100000:2.0:1788839237.169346:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108352 00000100:00100000:2.0:1788839237.169416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788839237.169427:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:8587:x1875733747108352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.169712:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:8587:x1875733747108352:12345-0@lo:502:llog_process_th.0 Request processed in 286us (15170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.169720:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788839237.169802:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8587:1875733747108352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839237.169842:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839237.169853:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839237.169855:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788839237.169862:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb02d49000 00000020:00000080:2.0:1788839237.169864:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788839237.169953:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8587:1875733747108480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.170000:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839237.170027:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108480 00000100:00100000:2.0:1788839237.170031:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108480 00000100:00100000:2.0:1788839237.170083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788839237.170090:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:8587:x1875733747108480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839237.170215:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:8587:x1875733747108480:12345-0@lo:502:llog_process_th.0 Request processed in 125us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839237.170221:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788839237.170264:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839237.170277:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:8587:1875733747108480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839237.170294:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839237.170303:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839237.170305:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788839237.170308:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788839237.170368:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788839237.170401:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839237.170410:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839237.170421:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839238.014747:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839238.721152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839238.721191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839238.721221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839238.721249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839238.721281:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254016 00000100:00100000:2.0:1788839238.721291:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254016 00000100:00100000:2.0:1788839238.721364:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254144 00000100:00100000:2.0:1788839238.721368:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254144 00000100:00100000:2.0:1788839238.721391:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1788839238.721403:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254016:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839238.721481:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254016:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839238.721489:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1788839238.721508:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1788839238.721517:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254144:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839238.721542:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254144:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839238.721566:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00080000:2.0:1788839238.721589:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839238.721594:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839238.721686:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729253888 00000100:00100000:2.0:1788839238.721690:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729253888 00000100:00100000:2.0:1788839238.721723:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:2.0:1788839238.721731:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729253888:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839238.721764:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729253888:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 34us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839238.721770:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00080000:2.0:1788839238.721787:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839238.722283:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729253760 00000100:00100000:1.0:1788839238.722290:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729253760 00000100:00100000:1.0:1788839238.722350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 192 00000100:00100000:1.0:1788839238.722358:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729253760:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839238.722396:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729253760:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 40us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839238.722403:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 192 00010000:00010000:3.0:1788839239.037178:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839239.997343:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747108864:0@lo:400:kworker.0 00000100:00100000:1.0:1788839239.997376:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747108608:0@lo:400:kworker.0 00000100:00100000:0.0:1788839240.000522:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839240.000580:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108864 00000100:00100000:3.0:1788839240.000588:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108864 00000100:00100000:0.0:1788839240.000599:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839240.000610:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747108992:0@lo:400:kworker.0 00000100:00100000:3.0:1788839240.000654:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839240.000738:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839240.000838:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747108864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839240.000909:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747108864:12345-0@lo:400:kworker.0 Request processed in 76us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839240.000917:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839240.001118:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747108864:0@lo:400:kworker.0 00000100:00100000:0.0:1788839240.002834:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747108736:0@lo:400:kworker.0 00000100:00080000:2.0:1788839240.002879:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839240.002897:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839240.002899:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108992 00000100:00100000:2.0:1788839240.002905:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108992 00000100:00100000:0.0:1788839240.002928:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747109248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839240.002951:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839240.002952:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839240.002960:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747108992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839240.003018:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747108992:12345-0@lo:400:kworker.0 Request processed in 59us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839240.003026:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788839240.003040:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747109248 00000100:00100000:2.0:1788839240.003044:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747109248 00000100:00100000:2.0:1788839240.003098:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788839240.003105:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747109248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839240.003140:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747109248:12345-0@lo:400:kworker.0 Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839240.003158:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788839240.003187:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108736 00000100:00100000:2.0:1788839240.003191:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108736 00000100:00100000:2.0:1788839240.003224:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839240.003232:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747108736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839240.003264:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747108736:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839240.003271:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788839240.003286:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839240.003289:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839240.003341:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747108736:0@lo:400:kworker.0 00010000:00080000:2.0:1788839240.003354:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f76d80 x1875733747109248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839240.003364:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747109248:0@lo:400:kworker.0 00010000:00080000:0.0:1788839240.004884:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f77480 x1875733747108992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839240.004900:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747108992:0@lo:400:kworker.0 00000100:00100000:1.0:1788839240.010373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839240.010449:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747109120:0@lo:400:kworker.0 00000100:00100000:1.0:1788839240.010513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839240.011155:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747109120 00000100:00100000:2.0:1788839240.011164:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747109120 00000100:00100000:2.0:1788839240.011234:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839240.011244:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747109120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839240.011306:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747109120:12345-0@lo:400:kworker.0 Request processed in 63us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839240.011313:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788839240.011348:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839240.012870:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747109120:0@lo:400:kworker.0 00000100:00100000:0.0:1788839240.014915:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747108608 00000100:00100000:0.0:1788839240.014927:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747108608 00000100:00100000:0.0:1788839240.014987:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788839240.014998:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747108608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839240.015140:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747108608:12345-0@lo:400:kworker.0 Request processed in 144us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839240.015148:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788839240.015311:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747108608:0@lo:400:kworker.0 00010000:00010000:3.0:1788839240.069927:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839240.512356:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747109376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839240.512436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839240.512519:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747109376 00000100:00100000:1.0:1788839240.512528:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747109376 00000100:00100000:1.0:1788839240.512573:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839240.512583:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747109376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839240.512617:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839240.512671:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747109376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839240.512678:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788839240.512722:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f75f80 x1875733747109376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839240.512752:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747109376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839241.022396:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839241.022422:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747109504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839241.022497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839241.022565:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747109504 00000100:00100000:2.0:1788839241.022572:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747109504 00000100:00100000:2.0:1788839241.022630:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839241.022655:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747109504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839241.022692:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839241.022750:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747109504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839241.022757:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788839241.022807:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3312a300 x1875733747109504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839241.022828:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747109504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839241.085228:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839242.109444:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839242.325771:0:8813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788839243.139822:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839243.833292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839243.833462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839243.833501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839243.833531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839243.833563:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254400 00000100:00100000:3.0:1788839243.833575:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254400 00000100:00100000:3.0:1788839243.833655:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1788839243.833668:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729254400:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839243.833762:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729254400:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839243.833771:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1788839243.833800:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254528 00000100:00100000:3.0:1788839243.833804:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254528 00000100:00100000:3.0:1788839243.833832:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254656 00000100:00100000:3.0:1788839243.833835:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254656 00000100:00100000:3.0:1788839243.833852:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1788839243.833858:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254528:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839243.833889:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254528:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839243.833911:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1788839243.833923:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1788839243.833930:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254656:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839243.833956:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729254656:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839243.833962:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00080000:3.0:1788839243.833976:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839243.833981:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839243.833983:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839243.837075:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254272 00000100:00100000:0.0:1788839243.837096:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254272 00000100:00100000:0.0:1788839243.837174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 194 00000100:00100000:0.0:1788839243.837187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729254272:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839243.837292:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729254272:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 108us (4014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839243.837301:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 194 00010000:00010000:0.0:1788839244.160938:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839245.127439:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747109888:0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.127535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839245.127612:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839245.127619:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747110016:0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.127650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839245.127712:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747109632:0@lo:400:kworker.0 00000100:00100000:3.0:1788839245.127756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839245.127797:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747110144:0@lo:400:kworker.0 00000100:00100000:3.0:1788839245.127822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839245.127845:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788839245.127850:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747109760:0@lo:400:kworker.0 00000100:00100000:3.0:1788839245.127875:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839245.127891:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747110272:0@lo:400:kworker.0 00000100:00100000:3.0:1788839245.127912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839245.135885:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747109888 00000100:00100000:0.0:1788839245.135907:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747109888 00000100:00100000:0.0:1788839245.136012:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110144 00000100:00100000:0.0:1788839245.136017:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110144 00000100:00100000:0.0:1788839245.136037:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747109760 00000100:00100000:0.0:1788839245.136039:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747109760 00000100:00100000:0.0:1788839245.136085:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839245.136097:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747109888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.136233:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747109888:12345-0@lo:400:kworker.0 Request processed in 138us (8697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839245.136242:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839245.136261:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839245.136268:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747110144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.136301:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747110144:12345-0@lo:400:kworker.0 Request processed in 34us (8478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839245.136308:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839245.136319:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839245.136324:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747109760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.136352:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747109760:12345-0@lo:400:kworker.0 Request processed in 28us (8476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839245.136359:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839245.136418:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747109888:0@lo:400:kworker.0 00000100:00080000:2.0:1788839245.136563:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839245.137307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747109632 00000100:00100000:0.0:1788839245.137317:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747109632 00000100:00100000:0.0:1788839245.137374:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788839245.137384:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747109632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.137443:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747109632:12345-0@lo:400:kworker.0 Request processed in 61us (9686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839245.137450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788839245.137490:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110016 00000100:00100000:0.0:1788839245.137494:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110016 00000100:00100000:0.0:1788839245.137537:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110272 00000100:00100000:0.0:1788839245.137541:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110272 00000100:00100000:0.0:1788839245.137558:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839245.137565:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747110016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.137605:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747110016:12345-0@lo:400:kworker.0 Request processed in 40us (9954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839245.137611:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839245.137621:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788839245.137628:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747110272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839245.137656:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747110272:12345-0@lo:400:kworker.0 Request processed in 29us (9743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839245.137663:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788839245.137698:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5c00 x1875733747110016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839245.137713:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747110016:0@lo:400:kworker.0 00000100:00080000:2.0:1788839245.137801:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839245.137805:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839245.138216:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747109760:0@lo:400:kworker.0 00010000:00080000:3.0:1788839245.138232:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c6300 x1875733747110272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839245.138243:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747110272:0@lo:400:kworker.0 00000100:00100000:3.0:1788839245.138253:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747109632:0@lo:400:kworker.0 00000100:00100000:3.0:1788839245.138288:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747110144:0@lo:400:kworker.0 00010000:00010000:3.0:1788839245.181835:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839245.632226:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839245.632261:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747110400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839245.632446:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839245.632544:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110400 00000100:00100000:1.0:1788839245.632555:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110400 00000100:00100000:1.0:1788839245.632620:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788839245.632633:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747110400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839245.632677:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839245.632732:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747110400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839245.632741:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788839245.632794:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f75f80 x1875733747110400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839245.632817:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747110400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839246.141326:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747110528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839246.141446:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839246.141897:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110528 00000100:00100000:2.0:1788839246.141908:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110528 00000100:00100000:2.0:1788839246.141993:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788839246.142006:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747110528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839246.142090:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839246.142151:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747110528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839246.142160:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788839246.142298:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3312a300 x1875733747110528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839246.142324:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747110528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839246.205249:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839247.233165:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839247.404848:0:9056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing yml_node 00010000:00010000:2.0:1788839248.262006:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839248.953693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839248.953883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839248.954190:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254912 00000100:00100000:0.0:1788839248.954201:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254912 00000100:00100000:0.0:1788839248.954292:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:0.0:1788839248.954305:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729254912:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839248.954392:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729254912:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 89us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839248.954401:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00080000:2.0:1788839248.954560:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839248.956595:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729254784 00000100:00100000:1.0:1788839248.956611:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729254784 00000100:00100000:1.0:1788839248.957596:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:1.0:1788839248.957615:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729254784:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839248.957710:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729254784:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 101us (4027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839248.957717:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:2.0:1788839248.959488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839248.960119:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255040 00000100:00100000:2.0:1788839248.960136:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255040 00000100:00100000:2.0:1788839248.960200:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1788839248.960211:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2354:x1875733729255040:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:2.0:1788839248.960246:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fc4d 00000100:00080000:2.0:1788839248.960256:0:6698:0:(import.c:65:import_set_state_nolock()) ffff91eb408c5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788839248.960293:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788839248.960626:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+2:2354:x1875733729255040:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 417us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839248.960635:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00010000:00010000:2.0:1788839248.960660:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839248.960668:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839248.968077:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839248.968299:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255168 00000100:00100000:1.0:1788839248.968310:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255168 00000100:00100000:1.0:1788839248.968382:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:1.0:1788839248.968393:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2354:x1875733729255168:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:1.0:1788839248.968439:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fc54 00000100:00080000:1.0:1788839248.968449:0:6697:0:(import.c:65:import_set_state_nolock()) ffff91eb408c1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839248.968486:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788839248.968836:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+2:2354:x1875733729255168:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 444us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839248.968844:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00010000:00010000:1.0:1788839248.968866:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839248.969172:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788839249.277431:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839250.237532:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747111040:0@lo:400:kworker.0 00000100:00100000:1.0:1788839250.237619:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747110912:0@lo:400:kworker.0 00000100:00100000:0.0:1788839250.237643:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839250.237747:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747110784:0@lo:400:kworker.0 00000100:00100000:3.0:1788839250.237833:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747110656:0@lo:400:kworker.0 00000100:00100000:0.0:1788839250.238276:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111040 00000100:00100000:0.0:1788839250.238288:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111040 00000100:00100000:0.0:1788839250.238365:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788839250.238377:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747111040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839250.241560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839250.241924:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839250.241960:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110912 00000100:00100000:2.0:1788839250.241975:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110912 00000100:00100000:2.0:1788839250.242629:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839250.242647:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747110912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839250.242810:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747110912:12345-0@lo:400:kworker.0 Request processed in 170us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839250.242818:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788839250.242848:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839250.242884:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839250.244867:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110784 00000100:00100000:2.0:1788839250.244899:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110784 00000100:00100000:2.0:1788839250.245455:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839250.245488:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747110784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839250.245593:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747110784:12345-0@lo:400:kworker.0 Request processed in 111us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839250.245601:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839250.245760:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747110784:0@lo:400:kworker.0 00000100:00100000:2.0:1788839250.245778:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747111296:0@lo:400:kworker.0 00000100:00100000:2.0:1788839250.245841:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839250.245844:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747110912:0@lo:400:kworker.0 00000100:00100000:2.0:1788839250.245918:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788839250.245933:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788839250.247602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839250.247649:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747110656 00000100:00100000:3.0:1788839250.247659:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747110656 00000100:00100000:3.0:1788839250.247718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788839250.247731:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747110656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839250.247804:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747110656:12345-0@lo:400:kworker.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839250.247813:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788839250.248042:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747110656:0@lo:400:kworker.0 00000100:00100000:3.0:1788839250.248075:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747111168:0@lo:400:kworker.0 00000100:00100000:3.0:1788839250.248117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839250.248146:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111168 00000100:00100000:3.0:1788839250.248150:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111168 00000100:00100000:2.0:1788839250.252161:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111296 00000100:00100000:2.0:1788839250.252181:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111296 00000100:00100000:0.0:1788839250.252572:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747111040:12345-0@lo:400:kworker.0 Request processed in 14190us (14924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839250.252587:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788839250.252709:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5500 x1875733747111040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839250.252729:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747111040:0@lo:400:kworker.0 00000100:00100000:3.0:1788839250.255434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839250.255526:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747111168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839250.255663:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747111168:12345-0@lo:400:kworker.0 Request processed in 143us (7544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839250.255671:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839250.255760:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747111168:0@lo:400:kworker.0 00000100:00080000:3.0:1788839250.255827:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839250.255834:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839250.256894:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839250.256911:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747111296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839250.257203:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747111296:12345-0@lo:400:kworker.0 Request processed in 296us (11366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839250.257210:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788839250.259019:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5880 x1875733747111296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839250.259044:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747111296:0@lo:400:kworker.0 00010000:00010000:1.0:1788839250.301377:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839250.755640:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747111424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839250.755751:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839250.755846:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111424 00000100:00100000:2.0:1788839250.755857:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111424 00000100:00100000:2.0:1788839250.755943:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839250.755955:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747111424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839250.756004:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839250.756109:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747111424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839250.756117:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788839250.757394:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33128e00 x1875733747111424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839250.757427:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747111424:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788839250.834398:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:3.0:1788839250.834541:0:6721:0:(genops.c:885:class_export_put()) final put ffff91eb408c3000/07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:2.0:1788839250.834655:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb408c3000/07d32060-78a7-4509-9f5d-feb437ccdae6 for lustre-OST0000 00000020:00000080:2.0:1788839250.834850:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb408c5800 for lustre-OST0000 00000100:00100000:0.0:1788839251.265681:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747111552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839251.265780:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839251.268896:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111552 00000100:00100000:1.0:1788839251.268916:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111552 00000100:00100000:1.0:1788839251.268994:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788839251.269008:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747111552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839251.269090:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839251.269202:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747111552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839251.269210:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788839251.269374:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8faa00 x1875733747111552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839251.269413:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747111552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788839251.328590:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839251.382789:0:9252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.115 00010000:00010000:2.0:1788839252.349252:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839253.374198:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788839253.409428:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:3.0:1788839253.409448:0:7651:0:(genops.c:885:class_export_put()) final put ffff91eb408c6800/07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:1.0:1788839253.409496:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb408c6800/07d32060-78a7-4509-9f5d-feb437ccdae6 for lustre-OST0001 00000020:00000080:1.0:1788839253.409539:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb408c1800 for lustre-OST0001 00000001:02000400:1.0:1788839253.779677:0:9349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.115 00000100:00100000:2.0:1788839254.076090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839254.076195:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255424 00000100:00100000:0.0:1788839254.076219:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255424 00000100:00100000:2.0:1788839254.076250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839254.076278:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255296 00000100:00100000:2.0:1788839254.076283:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255296 00000100:00100000:0.0:1788839254.076302:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:0.0:1788839254.076316:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729255424:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839254.076324:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 198 00000100:00100000:2.0:1788839254.076336:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2357:x1875733729255296:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839254.076395:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2357:x1875733729255296:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839254.076403:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 198 00000100:00080000:1.0:1788839254.076418:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839254.078028:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729255424:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 1709us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839254.078039:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00010000:00010000:1.0:1788839254.397882:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839255.360141:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747111680:0@lo:400:kworker.0 00000100:00100000:3.0:1788839255.360224:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839255.360375:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747111808:0@lo:400:kworker.0 00000100:00100000:0.0:1788839255.360414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839255.360463:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111808 00000100:00100000:0.0:1788839255.360470:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111808 00000100:00100000:0.0:1788839255.360514:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839255.360522:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747111808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839255.360571:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747111808:12345-0@lo:400:kworker.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839255.360578:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839255.360618:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747111808:0@lo:400:kworker.0 00000100:00100000:1.0:1788839255.360708:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111680 00000100:00100000:1.0:1788839255.360713:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111680 00000100:00100000:1.0:1788839255.360763:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788839255.360771:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747111680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839255.363288:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747112064:0@lo:400:kworker.0 00000100:00100000:2.0:1788839255.363358:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839255.363406:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839255.363413:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747111936:0@lo:400:kworker.0 00000100:00100000:2.0:1788839255.363439:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839255.363470:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747111936 00000100:00100000:2.0:1788839255.363476:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747111936 00000100:00100000:2.0:1788839255.363526:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788839255.363535:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747111936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839255.363590:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747111936:12345-0@lo:400:kworker.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839255.363597:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788839255.363619:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839255.363633:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747112320:0@lo:400:kworker.0 00000100:00100000:2.0:1788839255.363657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839255.363673:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839255.363678:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747112192:0@lo:400:kworker.0 00000100:00100000:2.0:1788839255.363700:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839255.363829:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112064 00000100:00100000:0.0:1788839255.363833:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112064 00000100:00100000:0.0:1788839255.363864:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112320 00000100:00100000:0.0:1788839255.363867:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112320 00000100:00100000:0.0:1788839255.363885:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788839255.363908:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747112064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839255.363944:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747112064:12345-0@lo:400:kworker.0 Request processed in 53us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839255.363950:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788839255.363963:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839255.363976:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747112320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839255.364009:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747112320:12345-0@lo:400:kworker.0 Request processed in 34us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839255.364016:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839255.364099:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747111936:0@lo:400:kworker.0 00010000:00080000:0.0:1788839255.364113:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3711a300 x1875733747112064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839255.364124:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747112064:0@lo:400:kworker.0 00000100:00080000:0.0:1788839255.364157:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839255.364160:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839255.364567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112192 00000100:00100000:2.0:1788839255.364573:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112192 00000100:00100000:2.0:1788839255.364612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788839255.364620:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747112192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839255.364659:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747112192:12345-0@lo:400:kworker.0 Request processed in 39us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839255.364665:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788839255.364696:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747112192:0@lo:400:kworker.0 00010000:00080000:2.0:1788839255.364708:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb37118e00 x1875733747112320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839255.364717:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747112320:0@lo:400:kworker.0 00000100:00080000:0.0:1788839255.364866:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839255.365123:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747111680:12345-0@lo:400:kworker.0 Request processed in 4351us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839255.365132:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788839255.365225:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747111680:0@lo:400:kworker.0 00010000:00010000:3.0:1788839255.422930:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839255.871479:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839255.872097:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747112448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839255.872187:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839255.872348:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112448 00000100:00100000:1.0:1788839255.872357:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112448 00000100:00100000:1.0:1788839255.872455:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839255.872468:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747112448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839255.872513:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839255.872574:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747112448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839255.872582:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788839255.872660:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f76300 x1875733747112448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839255.872680:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747112448:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788839256.133624:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.115 00000100:00100000:0.0:1788839256.387876:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747112576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839256.387964:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839256.397413:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112576 00000100:00100000:2.0:1788839256.397435:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112576 00000100:00100000:2.0:1788839256.397530:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839256.397543:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747112576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839256.397596:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839256.397701:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747112576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (9736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839256.397709:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788839256.397791:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5180 x1875733747112576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839256.397816:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747112576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839256.449449:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839257.471818:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839258.115434:0:9495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 23:47:37 EDT 2026 00010000:00010000:1.0:1788839258.493419:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839259.192788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839259.192847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839259.192885:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255680 00000100:00100000:1.0:1788839259.192899:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255680 00000100:00100000:1.0:1788839259.192986:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1788839259.193000:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729255680:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839259.193320:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729255680:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 322us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839259.193339:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00080000:1.0:1788839259.193368:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839259.196143:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255552 00000100:00100000:3.0:1788839259.196162:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255552 00000100:00100000:3.0:1788839259.197147:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 200 00000100:00100000:3.0:1788839259.197164:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:2355:x1875733729255552:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839259.197287:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+10:2355:x1875733729255552:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 128us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839259.197295:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 200 00010000:00010000:1.0:1788839259.523070:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839260.478318:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747112832:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.478422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839260.478495:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747113344:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.478526:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839260.478568:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788839260.478574:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747112704:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.478606:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839260.478627:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747113216:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.478648:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839260.478677:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747112960:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.478733:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839260.478756:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839260.478763:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747113088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.478787:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839260.478841:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112832 00000100:00100000:2.0:1788839260.478861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112832 00000100:00100000:2.0:1788839260.478916:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113216 00000100:00100000:2.0:1788839260.478920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113216 00000100:00100000:2.0:1788839260.478943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112960 00000100:00100000:2.0:1788839260.478945:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112960 00000100:00100000:2.0:1788839260.478964:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839260.478975:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747112832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479078:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747112832:12345-0@lo:400:kworker.0 Request processed in 105us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839260.479086:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839260.479118:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839260.479129:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747113216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479159:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747113216:12345-0@lo:400:kworker.0 Request processed in 34us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839260.479165:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839260.479177:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839260.479183:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747112960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747112960:12345-0@lo:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839260.479221:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839260.479241:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113344 00000100:00100000:2.0:1788839260.479245:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113344 00000100:00100000:2.0:1788839260.479274:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113088 00000100:00100000:2.0:1788839260.479277:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113088 00000100:00100000:2.0:1788839260.479298:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839260.479305:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747113344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479335:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747113344:12345-0@lo:400:kworker.0 Request processed in 32us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839260.479348:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839260.479359:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839260.479365:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747113088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479395:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747113088:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839260.479401:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788839260.479434:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839260.479439:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839260.479442:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788839260.479480:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3711a680 x1875733747113088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839260.479498:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747113088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479512:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747112960:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479548:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747113216:0@lo:400:kworker.0 00000100:00100000:2.0:1788839260.479559:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747112832:0@lo:400:kworker.0 00010000:00080000:2.0:1788839260.479570:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb37119180 x1875733747113344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839260.479581:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747113344:0@lo:400:kworker.0 00000100:00100000:1.0:1788839260.479981:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747112704 00000100:00100000:1.0:1788839260.479988:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747112704 00000100:00100000:1.0:1788839260.480039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788839260.480067:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747112704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839260.480122:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747112704:12345-0@lo:400:kworker.0 Request processed in 76us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839260.480129:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788839260.480175:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747112704:0@lo:400:kworker.0 00010000:00010000:1.0:1788839260.543372:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839260.989284:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839260.989316:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747113472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839260.989409:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839260.989498:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113472 00000100:00100000:0.0:1788839260.989509:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113472 00000100:00100000:0.0:1788839260.989578:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788839260.989590:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747113472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839260.989635:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839260.989715:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747113472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839260.989723:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788839260.989776:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c6a00 x1875733747113472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839260.989798:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747113472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839261.503044:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747113600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839261.503170:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839261.503283:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113600 00000100:00100000:1.0:1788839261.503295:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113600 00000100:00100000:1.0:1788839261.503358:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839261.503370:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747113600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839261.503422:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839261.503475:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747113600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839261.503483:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788839261.503536:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f74380 x1875733747113600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839261.503559:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747113600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839261.567408:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839262.589745:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839263.619734:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839264.312220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839264.312257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839264.312284:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255808 00000100:00100000:1.0:1788839264.312293:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255808 00000100:00100000:1.0:1788839264.312336:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:1.0:1788839264.312347:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2357:x1875733729255808:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839264.312409:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2357:x1875733729255808:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839264.312418:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:3.0:1788839264.312636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729255936 00000100:00100000:3.0:1788839264.312641:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729255936 00000100:00100000:3.0:1788839264.312698:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:3.0:1788839264.312707:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729255936:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839264.312753:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729255936:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 48us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839264.312760:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00080000:1.0:1788839264.313307:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788839264.638940:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839265.597742:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747113728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.597823:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839265.598194:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747113856:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.598207:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747113984:0@lo:400:kworker.0 00000100:00100000:2.0:1788839265.598232:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839265.598235:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747114112:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.598260:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839265.598296:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747114240:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.598343:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747114112 00000100:00100000:1.0:1788839265.598356:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747114112 00000100:00100000:1.0:1788839265.598416:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839265.598508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113856 00000100:00100000:0.0:1788839265.598513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113856 00000100:00100000:0.0:1788839265.598543:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839265.598551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747113856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839265.598560:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747114368:0@lo:400:kworker.0 00000100:00100000:3.0:1788839265.598726:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113728 00000100:00100000:3.0:1788839265.598731:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113728 00000100:00100000:2.0:1788839265.598756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839265.598762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788839265.598769:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747113728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839265.598806:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747113728:12345-0@lo:400:kworker.0 Request processed in 37us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839265.598813:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788839265.598920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747113856:12345-0@lo:400:kworker.0 Request processed in 370us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839265.598927:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788839265.598961:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747113856:0@lo:400:kworker.0 00000100:00100000:2.0:1788839265.598993:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747114368 00000100:00100000:2.0:1788839265.598996:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747114368 00000100:00100000:2.0:1788839265.599029:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839265.599036:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747114368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839265.599095:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747114368:12345-0@lo:400:kworker.0 Request processed in 59us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839265.599101:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788839265.599137:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c7100 x1875733747114368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839265.599147:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747114368:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.599158:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747114112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788839265.599190:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839265.599193:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747114112:12345-0@lo:400:kworker.0 Request processed in 769us (932us total) trans 0 rc 0/0 00000100:00080000:2.0:1788839265.599195:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839265.599205:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839265.599225:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788839265.599267:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5500 x1875733747114112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839265.599276:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747114112:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.599293:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839265.599315:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747113728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.599338:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747113984 00000100:00100000:1.0:1788839265.599342:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747113984 00000100:00100000:1.0:1788839265.599366:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747114240 00000100:00100000:1.0:1788839265.599369:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747114240 00000100:00100000:1.0:1788839265.599388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839265.599394:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747113984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839265.599402:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788839265.599409:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747114240:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788839265.599733:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839265.600576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747114240:12345-0@lo:400:kworker.0 Request processed in 1164us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839265.600597:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788839265.602259:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747114240:0@lo:400:kworker.0 00000100:00100000:0.0:1788839265.603860:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747113984:0@lo:400:kworker.0 00000100:00100000:1.0:1788839265.604778:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747113984:12345-0@lo:400:kworker.0 Request processed in 5381us (5548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839265.604791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1788839265.663176:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839266.111546:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747114496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839266.111632:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839266.114238:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747114496 00000100:00100000:3.0:1788839266.114251:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747114496 00000100:00100000:3.0:1788839266.114305:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839266.114316:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747114496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839266.114354:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839266.114441:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747114496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839266.114454:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788839266.114865:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb37118380 x1875733747114496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839266.114888:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747114496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839266.624273:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839266.624294:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747114624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839266.624360:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839266.624419:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747114624 00000100:00100000:1.0:1788839266.624426:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747114624 00000100:00100000:1.0:1788839266.624464:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839266.624485:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747114624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839266.624516:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839266.624559:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747114624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839266.624575:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788839266.624623:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09f74000 x1875733747114624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839266.624641:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747114624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839266.685425:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839267.710039:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839268.733291:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839269.435661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839269.435705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839269.435771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256064 00000100:00100000:2.0:1788839269.435781:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256064 00000100:00100000:2.0:1788839269.435834:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 204 00000100:00100000:2.0:1788839269.435845:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729256064:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839269.435922:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:2358:x1875733729256064:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839269.435929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 204 00000100:00100000:3.0:1788839269.436372:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256192 00000100:00100000:3.0:1788839269.436388:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256192 00000100:00100000:3.0:1788839269.436435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:3.0:1788839269.436442:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729256192:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839269.436477:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729256192:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 36us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839269.436482:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00080000:2.0:1788839269.438334:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788839269.759277:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839270.717642:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747114880:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.717735:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839270.717800:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747115392:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.717827:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839270.717864:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839270.717870:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747114752:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.717899:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839270.717921:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747115264:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.717944:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839270.717972:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747115136:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.717996:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839270.718015:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839270.718020:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747115008:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.718039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839270.718093:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115392 00000100:00100000:3.0:1788839270.718101:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115392 00000100:00100000:3.0:1788839270.718151:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115136 00000100:00100000:3.0:1788839270.718155:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115136 00000100:00100000:3.0:1788839270.718180:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839270.718190:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747115392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.718251:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747115392:12345-0@lo:400:kworker.0 Request processed in 62us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839270.718259:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839270.718276:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839270.718283:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747115136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.718315:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747115136:12345-0@lo:400:kworker.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839270.718321:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839270.718340:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747114752 00000100:00100000:3.0:1788839270.718345:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747114752 00000100:00100000:3.0:1788839270.718371:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788839270.718378:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747114752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.718406:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747114752:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839270.718411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788839270.718437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747114880 00000100:00100000:3.0:1788839270.718441:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747114880 00000100:00100000:3.0:1788839270.718462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115264 00000100:00100000:3.0:1788839270.718465:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115264 00000100:00100000:3.0:1788839270.718477:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115008 00000100:00100000:3.0:1788839270.718479:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115008 00000100:00100000:3.0:1788839270.718490:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839270.718496:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747114880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839270.718588:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839270.718597:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747115264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839270.718631:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747115264:12345-0@lo:400:kworker.0 Request processed in 36us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839270.718636:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839270.718649:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788839270.718654:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747115008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839270.718678:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747115008:12345-0@lo:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839270.718683:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788839270.718720:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747114880:12345-0@lo:400:kworker.0 Request processed in 39us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839270.718726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788839270.718749:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839270.718760:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839270.718763:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839270.718810:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747115008:0@lo:400:kworker.0 00010000:00080000:3.0:1788839270.718824:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb37118380 x1875733747115136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839270.718834:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747115136:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.718863:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747114752:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.718872:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747115264:0@lo:400:kworker.0 00000100:00100000:3.0:1788839270.718882:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747114880:0@lo:400:kworker.0 00010000:00080000:3.0:1788839270.718891:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3711a300 x1875733747115392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839270.718900:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747115392:0@lo:400:kworker.0 00010000:00010000:2.0:1788839270.782482:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839271.229465:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747115520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839271.229569:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839271.229646:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115520 00000100:00100000:1.0:1788839271.229655:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115520 00000100:00100000:1.0:1788839271.229717:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788839271.229728:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747115520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839271.229769:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839271.229822:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747115520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839271.229829:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788839271.229873:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3711a300 x1875733747115520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839271.229891:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747115520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839271.741725:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839271.741753:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747115648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839271.741830:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839271.741993:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115648 00000100:00100000:1.0:1788839271.742006:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115648 00000100:00100000:1.0:1788839271.742082:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788839271.742106:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747115648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839271.742142:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839271.742186:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747115648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839271.742193:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788839271.742283:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb1e5c4e00 x1875733747115648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839271.742304:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747115648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839271.805850:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839272.829421:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839273.854643:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839274.094005:0:10126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:47:53 (1788839273) === 00000100:00100000:1.0:1788839274.559428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839274.559513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839274.559536:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256320 00000100:00100000:2.0:1788839274.559553:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256320 00000100:00100000:2.0:1788839274.559708:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00100000:2.0:1788839274.559722:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2355:x1875733729256320:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839274.559828:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+10:2355:x1875733729256320:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 108us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839274.559836:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00100000:3.0:1788839274.559942:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256448 00000100:00100000:3.0:1788839274.559948:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256448 00000100:00100000:3.0:1788839274.560002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:3.0:1788839274.560011:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729256448:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839274.560110:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729256448:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 101us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839274.560118:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00080000:3.0:1788839274.560139:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839274.871346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839274.871603:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256576 00000100:00100000:2.0:1788839274.871619:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256576 00000100:00100000:2.0:1788839274.871716:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 207 00000100:00100000:2.0:1788839274.871730:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:8127:x1875733729256576:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788839274.871760:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839274.871790:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964600/0x4b63896d6363fd18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbae81 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839274.871830:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964600/0x4b63896d6363fd18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae81 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839274.871842:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964600/0x4b63896d6363fd18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae81 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839274.871853:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964600, rc 0) 00000100:00100000:2.0:1788839274.871937:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+11:8127:x1875733729256576:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 209us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839274.871945:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 207 00010000:00010000:2.0:1788839274.880996:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839274.885124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839274.886100:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256704 00000100:00100000:2.0:1788839274.886116:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256704 00000100:00100000:2.0:1788839274.886212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 208 00000100:00100000:2.0:1788839274.886225:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+11:8127:x1875733729256704:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788839274.887347:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+11:8127:x1875733729256704:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 1114us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839274.887360:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 208 00000100:00100000:1.0:1788839274.907247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839274.907374:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256832 00000100:00100000:0.0:1788839274.907388:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256832 00000100:00100000:0.0:1788839274.907484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 209 00000100:00100000:0.0:1788839274.907497:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+11:8127:x1875733729256832:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788839274.907819:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+11:8127:x1875733729256832:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 324us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839274.907827:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 209 00000100:00100000:3.0:1788839274.917253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839274.917622:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729256960 00000100:00100000:2.0:1788839274.917659:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729256960 00000100:00100000:2.0:1788839274.917742:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 210 00000100:00100000:2.0:1788839274.917755:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+11:8131:x1875733729256960:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839274.918216:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+11:8131:x1875733729256960:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 460us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839274.918225:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 210 00000100:00100000:1.0:1788839275.003630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839275.006201:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257088 00000100:00100000:3.0:1788839275.006228:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257088 00000100:00100000:3.0:1788839275.006359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:3.0:1788839275.006373:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+11:8131:x1875733729257088:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839275.006810:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+11:8131:x1875733729257088:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 438us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839275.006820:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:1.0:1788839275.016295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839275.016621:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257216 00000100:00100000:0.0:1788839275.016635:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257216 00000100:00100000:0.0:1788839275.016922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:0.0:1788839275.016935:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+11:8127:x1875733729257216:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788839275.016958:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839275.016982:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c7200/0x4b63896d6363fd1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaeab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839275.017029:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c7200/0x4b63896d6363fd1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeab expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839275.017043:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c7200/0x4b63896d6363fd1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeab expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839275.017081:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7200, rc 0) 00000100:00100000:0.0:1788839275.018383:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+12:8127:x1875733729257216:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 233us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839275.018394:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:0.0:1788839275.026268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839275.026465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257344 00000100:00100000:2.0:1788839275.026479:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257344 00000100:00100000:2.0:1788839275.026557:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:2.0:1788839275.026570:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:8127:x1875733729257344:12345-192.168.201.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788839275.026896:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788839275.026931:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788839275.026936:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788839275.026939:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788839275.026941:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788839275.035657:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:8127:x1875733729257344:12345-192.168.201.9@tcp:256:mount.lustre.0 Request processed in 9071us (9386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839275.035675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:1.0:1788839275.068024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839275.068346:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257472 00000100:00100000:0.0:1788839275.068360:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257472 00000100:00100000:0.0:1788839275.068450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 214 00000100:00100000:0.0:1788839275.068463:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+12:8127:x1875733729257472:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788839275.068488:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839275.068516:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaeb2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839275.068555:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839275.068831:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839275.068844:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839275.068934:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:8127:x1875733729257472:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 473us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839275.068943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 214 00000100:00100000:0.0:1788839275.081842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839275.082042:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257600 00000100:00100000:2.0:1788839275.082101:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257600 00000100:00100000:2.0:1788839275.082201:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:2.0:1788839275.082214:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:8127:x1875733729257600:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788839275.086880:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:8127:x1875733729257600:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 475us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839275.086903:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:1.0:1788839275.093018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839275.093245:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257728 00000100:00100000:3.0:1788839275.093259:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257728 00000100:00100000:3.0:1788839275.093333:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:3.0:1788839275.093345:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:8127:x1875733729257728:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788839275.093843:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:8127:x1875733729257728:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 497us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839275.093853:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:1.0:1788839275.100214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839275.102441:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257856 00000100:00100000:2.0:1788839275.102488:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257856 00000100:00100000:2.0:1788839275.102598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:2.0:1788839275.102611:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:8133:x1875733729257856:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839275.102984:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:8133:x1875733729257856:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 373us (2784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839275.102993:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:1.0:1788839275.119802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839275.124238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729257984 00000100:00100000:3.0:1788839275.124261:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729257984 00000100:00100000:3.0:1788839275.124356:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:3.0:1788839275.124370:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:8133:x1875733729257984:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839275.124772:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:8133:x1875733729257984:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 403us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839275.124782:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:1.0:1788839275.152483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839275.152552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839275.152861:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729258496 00000100:00100000:3.0:1788839275.152876:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729258496 00000100:00100000:3.0:1788839275.152956:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729258112 00000100:00100000:3.0:1788839275.152960:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729258112 00000100:00100000:3.0:1788839275.152989:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:3.0:1788839275.153002:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729258496:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839275.153131:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729258496:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 132us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839275.153158:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:3.0:1788839275.153192:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:3.0:1788839275.153197:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1875733729258112:12345-192.168.201.9@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788839275.153227:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8e05aa00-5dd5-4619-9642-ae49ffaf889b@192.168.201.9@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788839275.153279:0:5842:0:(genops.c:1385:class_connect()) connect: client 8e05aa00-5dd5-4619-9642-ae49ffaf889b, cookie 0x4b63896d6363fd2d 00000004:00100000:3.0:1788839275.153320:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788839275.153681:0:5842:0:(import.c:65:import_set_state_nolock()) ffff91eb375e6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839275.155693:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2354:x1875733729258112:12345-192.168.201.9@tcp:38:mount.lustre.0 Request processed in 2475us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839275.155709:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1788839275.163045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839275.163148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839275.163380:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729258240 00000100:00100000:0.0:1788839275.163404:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729258240 00000100:00100000:0.0:1788839275.163568:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729258368 00000100:00100000:0.0:1788839275.163572:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729258368 00000100:00100000:2.0:1788839275.164144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839275.164162:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+7:0:x1875733729258240:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788839275.164395:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788839275.164517:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839275.164559:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:3.0:1788839275.164571:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+7:8127:x1875733729258368:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788839275.164585:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788839275.167247:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+7:8127:x1875733729258368:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 2666us (4085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839275.167263:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1788839275.175255:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:0:x1875733729258240:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 11090us (12226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839275.175255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839275.175270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839275.175305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729258624 00000100:00100000:2.0:1788839275.175313:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729258624 00000100:00100000:2.0:1788839275.175354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1788839275.175363:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:8127:x1875733729258624:12345-192.168.201.9@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788839275.175423:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:8127:x1875733729258624:12345-192.168.201.9@tcp:40:mount.lustre.0 Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839275.175488:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1788839275.188873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839275.189201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839275.189237:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839275.189308:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729258752 00000100:00100000:2.0:1788839275.189324:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729258752 00000100:00100000:2.0:1788839275.189365:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729258880 00000100:00100000:2.0:1788839275.189379:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729258880 00000100:00100000:2.0:1788839275.189408:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1788839275.189417:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875733729258752:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788839275.189461:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8e05aa00-5dd5-4619-9642-ae49ffaf889b@192.168.201.9@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1788839275.189496:0:6697:0:(genops.c:1385:class_connect()) connect: client 8e05aa00-5dd5-4619-9642-ae49ffaf889b, cookie 0x4b63896d6363fd34 00002000:00100000:2.0:1788839275.189507:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8e05aa00-5dd5-4619-9642-ae49ffaf889b/ffff91eb0b856800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788839275.189531:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788839275.189569:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259008 00000100:00100000:0.0:1788839275.189581:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259008 00000100:00100000:0.0:1788839275.189649:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:0.0:1788839275.189666:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:8127:x1875733729259008:12345-192.168.201.9@tcp:33:mount.lustre.0 00002000:00080000:2.0:1788839275.189778:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788839275.189809:0:6697:0:(import.c:65:import_set_state_nolock()) ffff91eb0b857000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839275.189875:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2354:x1875733729258752:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 458us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839275.189883:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1788839275.189903:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1788839275.189908:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875733729258880:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788839275.189923:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8e05aa00-5dd5-4619-9642-ae49ffaf889b@192.168.201.9@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1788839275.189937:0:6697:0:(genops.c:1385:class_connect()) connect: client 8e05aa00-5dd5-4619-9642-ae49ffaf889b, cookie 0x4b63896d6363fd3b 00002000:00100000:2.0:1788839275.189942:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8e05aa00-5dd5-4619-9642-ae49ffaf889b/ffff91eb0b853000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788839275.189955:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788839275.190107:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788839275.190121:0:6697:0:(import.c:65:import_set_state_nolock()) ffff91eb0b853800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839275.190142:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2354:x1875733729258880:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 232us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839275.190148:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000004:00200000:0.0:1788839275.191891:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788839275.193733:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:8127:x1875733729259008:12345-192.168.201.9@tcp:33:mount.lustre.0 Request processed in 4063us (4865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839275.193747:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:2.0:1788839275.837619:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747116032:0@lo:400:kworker.0 00000100:00100000:2.0:1788839275.837744:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839275.837845:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839275.837852:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747116160:0@lo:400:kworker.0 00000100:00100000:2.0:1788839275.837883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839275.838072:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116032 00000100:00100000:0.0:1788839275.838082:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116032 00000100:00100000:3.0:1788839275.838196:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747115904:0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.838235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839275.838261:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747116416:0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.838283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839275.838305:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839275.838312:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747115776:0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.838344:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839275.838367:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747116288:0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.838391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839275.838704:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839275.838780:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116160 00000100:00100000:1.0:1788839275.838793:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116160 00000100:00100000:1.0:1788839275.838835:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116416 00000100:00100000:1.0:1788839275.838838:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116416 00000100:00100000:1.0:1788839275.838862:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839275.838872:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747116160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839275.838940:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747116160:12345-0@lo:400:kworker.0 Request processed in 69us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839275.838947:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839275.838966:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839275.838972:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747116416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839275.839016:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747116416:12345-0@lo:400:kworker.0 Request processed in 44us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839275.839022:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788839275.839099:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5500 x1875733747116160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839275.839115:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747116160:0@lo:400:kworker.0 00000100:00080000:1.0:1788839275.839138:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839275.839141:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839275.839165:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115776 00000100:00100000:1.0:1788839275.839169:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115776 00000100:00100000:1.0:1788839275.839195:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788839275.839201:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747115776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839275.839232:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747115776:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839275.839238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788839275.839284:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747115776:0@lo:400:kworker.0 00010000:00080000:1.0:1788839275.839310:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5f80 x1875733747116416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839275.839322:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747116416:0@lo:400:kworker.0 00000100:00100000:0.0:1788839275.845199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747115904 00000100:00100000:0.0:1788839275.845222:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747115904 00000100:00100000:3.0:1788839275.849219:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116288 00000100:00100000:3.0:1788839275.849240:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116288 00000100:00100000:3.0:1788839275.849334:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788839275.849347:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747116032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.849497:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747116032:12345-0@lo:400:kworker.0 Request processed in 152us (11753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839275.849504:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788839275.849524:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788839275.849530:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747115904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.849563:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747115904:12345-0@lo:400:kworker.0 Request processed in 33us (11327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839275.849569:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788839275.849579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788839275.849585:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747116288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.849608:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747116288:12345-0@lo:400:kworker.0 Request processed in 24us (11217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839275.849614:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788839275.849675:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747116288:0@lo:400:kworker.0 00000100:00100000:3.0:1788839275.849688:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747115904:0@lo:400:kworker.0 00000100:00080000:3.0:1788839275.849720:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839275.849741:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747116032:0@lo:400:kworker.0 00010000:00010000:1.0:1788839275.904594:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839276.350556:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747116544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839276.350657:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839276.350752:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116544 00000100:00100000:2.0:1788839276.350762:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116544 00000100:00100000:2.0:1788839276.350820:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839276.350830:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747116544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839276.350877:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839276.350944:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747116544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839276.350952:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788839276.351010:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb37118380 x1875733747116544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839276.351033:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747116544:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788839276.484045:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e05aa00-5dd5-4619-9642-ae49ffaf889b 00000100:00100000:1.0:1788839276.867157:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839276.867191:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747116672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839276.867292:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839276.867384:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116672 00000100:00100000:1.0:1788839276.867394:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116672 00000100:00100000:1.0:1788839276.867472:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839276.867483:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747116672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839276.867537:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839276.867593:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747116672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839276.867601:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788839276.867656:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10754000 x1875733747116672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839276.867680:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747116672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788839276.934678:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839277.958827:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788839278.968318:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e05aa00-5dd5-4619-9642-ae49ffaf889b 00010000:00010000:1.0:1788839278.978193:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788839278.986472:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e05aa00-5dd5-4619-9642-ae49ffaf889b 00010000:00010000:1.0:1788839279.997601:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839280.702373:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839280.702433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839280.702505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839280.702538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839280.702618:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259136 00000100:00100000:2.0:1788839280.702633:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259136 00000100:00100000:2.0:1788839280.702696:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:2.0:1788839280.702709:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2358:x1875733729259136:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839280.703872:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2358:x1875733729259136:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 1153us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839280.703886:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:2.0:1788839280.703983:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259648 00000100:00100000:2.0:1788839280.703992:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259648 00000100:00100000:2.0:1788839280.704045:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:2.0:1788839280.704075:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729259648:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839280.704123:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729259648:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 51us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839280.704130:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00080000:2.0:1788839280.704156:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839280.706544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839280.712277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259392 00000100:00100000:0.0:1788839280.712314:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259392 00000100:00100000:0.0:1788839280.712494:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259264 00000100:00100000:0.0:1788839280.712498:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259264 00000100:00100000:0.0:1788839280.712548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:0.0:1788839280.712563:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729259392:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839280.712583:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259520 00000100:00100000:2.0:1788839280.712591:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259520 00000100:00100000:2.0:1788839280.712649:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:2.0:1788839280.712661:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729259520:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839280.712704:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729259520:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 44us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839280.712705:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729259392:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 142us (10268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839280.712722:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:0.0:1788839280.712723:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:0.0:1788839280.712748:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:0.0:1788839280.712756:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729259264:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839280.712786:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729259264:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 31us (10248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839280.712792:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00080000:3.0:1788839280.713239:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839280.713246:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839280.957561:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747117056:0@lo:400:kworker.0 00000100:00100000:2.0:1788839280.957677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839280.957774:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839280.957782:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747117184:0@lo:400:kworker.0 00000100:00100000:2.0:1788839280.957813:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839280.957860:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117184 00000100:00100000:2.0:1788839280.957870:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117184 00000100:00100000:2.0:1788839280.957941:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839280.957954:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747117184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839280.958018:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747117184:12345-0@lo:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839280.958081:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788839280.958141:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5f80 x1875733747117184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839280.958159:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747117184:0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.958468:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747116928:0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.958514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839280.958551:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747117440:0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.958586:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839280.958611:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839280.958619:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747116800:0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.958651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839280.958681:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747117312:0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.958705:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839280.958743:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116800 00000100:00100000:3.0:1788839280.958748:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116800 00000100:00100000:3.0:1788839280.958788:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788839280.958796:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747116800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.958839:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747116800:12345-0@lo:400:kworker.0 Request processed in 44us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839280.958846:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788839280.958884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117056 00000100:00100000:3.0:1788839280.958889:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117056 00000100:00100000:3.0:1788839280.958919:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747116928 00000100:00100000:3.0:1788839280.958923:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747116928 00000100:00100000:3.0:1788839280.958936:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117312 00000100:00100000:3.0:1788839280.958938:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117312 00000100:00100000:3.0:1788839280.958953:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788839280.958974:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747117056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.959020:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747117056:12345-0@lo:400:kworker.0 Request processed in 47us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839280.959027:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788839280.959042:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788839280.959086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747116928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.959116:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747116928:12345-0@lo:400:kworker.0 Request processed in 68us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839280.959124:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788839280.959135:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788839280.959142:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747117312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839280.959169:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747117312:12345-0@lo:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839280.959175:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788839280.959383:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839280.959391:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839280.959406:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117440 00000100:00100000:0.0:1788839280.959410:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117440 00000100:00100000:0.0:1788839280.959449:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839280.959458:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747117440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839280.959500:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747117440:12345-0@lo:400:kworker.0 Request processed in 44us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839280.959507:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788839280.959523:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839280.959557:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747116800:0@lo:400:kworker.0 00000100:00100000:0.0:1788839280.959637:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747117312:0@lo:400:kworker.0 00000100:00100000:0.0:1788839280.959651:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747116928:0@lo:400:kworker.0 00010000:00080000:0.0:1788839280.959678:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c5500 x1875733747117440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839280.959690:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747117440:0@lo:400:kworker.0 00000100:00100000:0.0:1788839280.959739:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747117056:0@lo:400:kworker.0 00010000:00010000:1.0:1788839281.039494:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839281.469647:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839281.469687:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747117568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839281.470258:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839281.470417:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117568 00000100:00100000:2.0:1788839281.470429:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117568 00000100:00100000:2.0:1788839281.470494:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839281.470506:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747117568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839281.470556:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839281.470618:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747117568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839281.470625:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788839281.471120:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40acdf80 x1875733747117568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839281.471147:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747117568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839281.981904:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747117696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839281.982004:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839281.982133:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117696 00000100:00100000:1.0:1788839281.982145:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117696 00000100:00100000:1.0:1788839281.982223:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839281.982237:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747117696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839281.982300:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839281.982377:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747117696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839281.982385:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788839281.982486:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10754000 x1875733747117696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839281.982510:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747117696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839282.045867:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788839282.947126:0:10321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788839283.078096:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839284.105475:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839285.120373:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839285.827329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839285.827381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839285.827928:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259904 00000100:00100000:2.0:1788839285.827942:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259904 00000100:00100000:2.0:1788839285.828025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:2.0:1788839285.828037:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729259904:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839285.828154:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729259904:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 120us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839285.828163:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00080000:2.0:1788839285.828189:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839285.828569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839285.828602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839285.828628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839285.831505:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729259776 00000100:00100000:2.0:1788839285.831526:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729259776 00000100:00100000:2.0:1788839285.831614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 222 00000100:00100000:2.0:1788839285.831628:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2358:x1875733729259776:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839285.831737:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2358:x1875733729259776:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 113us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839285.831746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 222 00000100:00100000:2.0:1788839285.831953:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260032 00000100:00100000:2.0:1788839285.831958:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260032 00000100:00100000:2.0:1788839285.831999:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:2.0:1788839285.832006:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260032:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839285.832038:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260032:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 33us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839285.832045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00080000:2.0:1788839285.832089:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839285.854949:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260160 00000100:00100000:1.0:1788839285.854971:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260160 00000100:00100000:1.0:1788839285.855098:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260288 00000100:00100000:1.0:1788839285.855102:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260288 00000100:00100000:1.0:1788839285.855133:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1788839285.855149:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260160:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839285.855282:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260160:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 138us (27900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839285.855290:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1788839285.855312:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1788839285.855317:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260288:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839285.855339:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260288:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 22us (26711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839285.855346:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00080000:3.0:1788839285.855891:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839285.855898:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839286.087391:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747117952:0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.087507:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839286.096115:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747118080:0@lo:400:kworker.0 00000100:00100000:3.0:1788839286.099514:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747117824:0@lo:400:kworker.0 00000100:00100000:3.0:1788839286.099698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839286.099781:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747118336:0@lo:400:kworker.0 00000100:00100000:3.0:1788839286.099825:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117824 00000100:00100000:3.0:1788839286.099836:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117824 00000100:00100000:3.0:1788839286.099916:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788839286.099928:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747117824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839286.099998:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747117824:12345-0@lo:400:kworker.0 Request processed in 72us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839286.100006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788839286.105115:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747118208:0@lo:400:kworker.0 00000100:00100000:3.0:1788839286.106156:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839286.109076:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118208 00000100:00100000:2.0:1788839286.109106:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118208 00000100:00100000:2.0:1788839286.109490:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788839286.109508:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747118208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.111385:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747118464:0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.111453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839286.111557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839286.113370:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118464 00000100:00100000:1.0:1788839286.113391:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118464 00000100:00100000:1.0:1788839286.113486:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839286.113500:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747118464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839286.120527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839286.120718:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747117824:0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.121798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747117952 00000100:00100000:0.0:1788839286.121823:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747117952 00000100:00100000:0.0:1788839286.121909:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118080 00000100:00100000:0.0:1788839286.121913:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118080 00000100:00100000:0.0:1788839286.121939:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118336 00000100:00100000:0.0:1788839286.121941:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118336 00000100:00100000:0.0:1788839286.121998:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839286.122014:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747117952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.122194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747117952:12345-0@lo:400:kworker.0 Request processed in 184us (34687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839286.122202:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839286.122247:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839286.122253:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747118080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.122292:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747118080:12345-0@lo:400:kworker.0 Request processed in 39us (10735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839286.122298:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839286.122310:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788839286.122316:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747118336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.122350:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747118336:12345-0@lo:400:kworker.0 Request processed in 34us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839286.122356:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788839286.122407:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747117952:0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.122455:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747118080:0@lo:400:kworker.0 00000100:00100000:0.0:1788839286.122487:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747118336:0@lo:400:kworker.0 00000100:00080000:0.0:1788839286.128676:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839286.128695:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839286.128698:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839286.130963:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747118208:12345-0@lo:400:kworker.0 Request processed in 21437us (24795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839286.130995:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788839286.131140:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40acf100 x1875733747118208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839286.131162:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747118208:0@lo:400:kworker.0 00010000:00010000:2.0:1788839286.142354:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839286.156793:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747118464:12345-0@lo:400:kworker.0 Request processed in 43280us (45323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839286.156825:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788839286.157205:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40acca80 x1875733747118464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839286.157229:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747118464:0@lo:400:kworker.0 00000100:00100000:1.0:1788839286.591399:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839286.591470:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747118592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839286.591580:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839286.592660:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118592 00000100:00100000:3.0:1788839286.592675:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118592 00000100:00100000:3.0:1788839286.592750:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839286.592761:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747118592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839286.592824:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839286.592911:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747118592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839286.592918:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788839286.592977:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fce680 x1875733747118592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839286.593347:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747118592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839287.102544:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747118720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839287.102656:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839287.102956:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118720 00000100:00100000:1.0:1788839287.102968:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118720 00000100:00100000:1.0:1788839287.103038:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839287.103081:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747118720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839287.103131:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839287.103903:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747118720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 850us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839287.103914:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788839287.104951:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10755c00 x1875733747118720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839287.104985:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747118720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839287.165709:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839288.189665:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839289.213728:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839290.244977:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839290.949926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839290.950025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839290.950107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839290.950134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839290.950174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839290.950204:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260416 00000100:00100000:1.0:1788839290.950214:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260416 00000100:00100000:1.0:1788839290.950279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:1.0:1788839290.950291:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2358:x1875733729260416:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839290.950365:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2358:x1875733729260416:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 77us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839290.950372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:1.0:1788839290.950430:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260672 00000100:00100000:1.0:1788839290.950434:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260672 00000100:00100000:1.0:1788839290.950472:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260544 00000100:00100000:1.0:1788839290.950475:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260544 00000100:00100000:1.0:1788839290.950515:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:1.0:1788839290.950522:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260672:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839290.950554:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260672:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839290.950560:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:1.0:1788839290.950573:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:1.0:1788839290.950579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729260544:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839290.950603:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729260544:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839290.950609:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:1.0:1788839290.950640:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260928 00000100:00100000:1.0:1788839290.950644:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260928 00000100:00100000:1.0:1788839290.950672:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729260800 00000100:00100000:1.0:1788839290.950674:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729260800 00000100:00100000:1.0:1788839290.950693:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:1.0:1788839290.950700:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260928:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839290.950725:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260928:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839290.950744:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:1.0:1788839290.950915:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:1.0:1788839290.950922:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260800:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839290.950947:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729260800:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839290.950953:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00080000:1.0:1788839290.950980:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839290.950991:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839290.950994:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839291.198524:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747118976:0@lo:400:kworker.0 00000100:00100000:0.0:1788839291.198583:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747119104:0@lo:400:kworker.0 00000100:00100000:3.0:1788839291.198663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747118848:0@lo:400:kworker.0 00000100:00100000:2.0:1788839291.198842:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839291.198911:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747119488:0@lo:400:kworker.0 00000100:00100000:2.0:1788839291.198939:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839291.199561:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118976 00000100:00100000:1.0:1788839291.199578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118976 00000100:00100000:1.0:1788839291.199655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839291.199666:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747118976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839291.200119:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747118976:12345-0@lo:400:kworker.0 Request processed in 454us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839291.200127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839291.200163:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747119488 00000100:00100000:1.0:1788839291.200167:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747119488 00000100:00100000:1.0:1788839291.200198:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788839291.200203:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747119488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839291.200240:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747118976:0@lo:400:kworker.0 00000100:00100000:1.0:1788839291.200402:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747119488:12345-0@lo:400:kworker.0 Request processed in 198us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839291.200408:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788839291.200424:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788839291.200551:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10757b80 x1875733747119488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839291.200562:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747119488:0@lo:400:kworker.0 00000100:00100000:0.0:1788839291.200946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839291.200966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839291.200996:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839291.200998:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747119360:0@lo:400:kworker.0 00000100:00100000:0.0:1788839291.201003:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747119232:0@lo:400:kworker.0 00000100:00100000:3.0:1788839291.201027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839291.201028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839291.201077:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747119232 00000100:00100000:0.0:1788839291.201082:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747119232 00000100:00100000:0.0:1788839291.201126:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788839291.201127:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839291.201135:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747119232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839291.201189:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747119232:12345-0@lo:400:kworker.0 Request processed in 56us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839291.201197:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788839291.201219:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10755500 x1875733747119232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839291.201230:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747119232:0@lo:400:kworker.0 00000100:00100000:1.0:1788839291.201289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747119104 00000100:00100000:1.0:1788839291.201293:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747119104 00000100:00100000:1.0:1788839291.201323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747119360 00000100:00100000:1.0:1788839291.201326:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747119360 00000100:00080000:3.0:1788839291.201330:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839291.201347:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788839291.201354:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747119104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839291.201355:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839291.201361:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747119360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839291.201391:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747119360:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839291.201391:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747119104:12345-0@lo:400:kworker.0 Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839291.201397:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788839291.201407:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839291.201498:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747119360:0@lo:400:kworker.0 00000100:00100000:2.0:1788839291.201614:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747118848 00000100:00100000:2.0:1788839291.201619:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747118848 00000100:00100000:2.0:1788839291.201645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788839291.201652:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747118848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839291.201689:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747118848:12345-0@lo:400:kworker.0 Request processed in 38us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839291.201696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788839291.201705:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747118848:0@lo:400:kworker.0 00000100:00100000:1.0:1788839291.201902:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747119104:0@lo:400:kworker.0 00010000:00010000:2.0:1788839291.261384:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839291.709408:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747119616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839291.709499:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839291.709625:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747119616 00000100:00100000:3.0:1788839291.709634:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747119616 00000100:00100000:3.0:1788839291.709684:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839291.709695:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747119616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839291.709741:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839291.709787:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747119616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839291.709794:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788839291.710244:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fcc380 x1875733747119616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839291.710266:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747119616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839292.226363:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839292.226397:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747119744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839292.226499:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839292.226594:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747119744 00000100:00100000:1.0:1788839292.226603:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747119744 00000100:00100000:1.0:1788839292.226670:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788839292.226682:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747119744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839292.226731:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839292.226799:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747119744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839292.226807:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788839292.226854:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10756a00 x1875733747119744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839292.226878:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747119744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788839292.286445:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839293.310578:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839294.333983:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839295.358498:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839296.063462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839296.063568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839296.063605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839296.063673:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261056 00000100:00100000:3.0:1788839296.063698:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261056 00000100:00100000:3.0:1788839296.063757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 226 00000100:00100000:3.0:1788839296.063768:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729261056:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839296.063832:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729261056:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 67us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839296.063839:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 226 00000100:00100000:1.0:1788839296.064426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839296.064453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839296.064475:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261440 00000100:00100000:1.0:1788839296.064486:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261440 00000100:00100000:1.0:1788839296.064531:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261568 00000100:00100000:1.0:1788839296.064534:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261568 00000100:00100000:1.0:1788839296.064557:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:1.0:1788839296.064564:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2354:x1875733729261440:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:1.0:1788839296.064585:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fd34 00000100:00080000:1.0:1788839296.064592:0:6698:0:(import.c:65:import_set_state_nolock()) ffff91eb0b857000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839296.064625:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788839296.064954:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+2:2354:x1875733729261440:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 389us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839296.064961:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:1.0:1788839296.064975:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:1.0:1788839296.064981:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2354:x1875733729261568:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:1.0:1788839296.064991:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fd3b 00000100:00080000:1.0:1788839296.064996:0:6698:0:(import.c:65:import_set_state_nolock()) ffff91eb0b853800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839296.065012:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788839296.065234:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+2:2354:x1875733729261568:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 251us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839296.065240:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00080000:1.0:1788839296.066871:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839296.066883:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788839296.066912:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839296.068625:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261184 00000100:00100000:2.0:1788839296.068641:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261184 00000100:00100000:2.0:1788839296.068725:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261312 00000100:00100000:2.0:1788839296.068729:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261312 00000100:00100000:2.0:1788839296.068759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:2.0:1788839296.068770:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729261184:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839296.068867:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729261184:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 99us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839296.068875:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:2.0:1788839296.068893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:2.0:1788839296.068912:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729261312:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839296.068938:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729261312:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 39us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839296.068944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 78 00010000:00010000:2.0:1788839296.071219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839296.071233:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839296.317365:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747120000:0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.317433:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747119872:0@lo:400:kworker.0 00000100:00100000:1.0:1788839296.317499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839296.317503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839296.317607:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747120256:0@lo:400:kworker.0 00000100:00100000:1.0:1788839296.317670:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747120512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.325556:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747120384:0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.325697:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839296.325768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747119872 00000100:00100000:3.0:1788839296.325776:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747119872 00000100:00100000:3.0:1788839296.325822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788839296.325831:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747119872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.325882:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747119872:12345-0@lo:400:kworker.0 Request processed in 52us (8381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839296.325890:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788839296.325923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120000 00000100:00100000:3.0:1788839296.325926:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120000 00000100:00100000:3.0:1788839296.325947:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120384 00000100:00100000:3.0:1788839296.325950:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120384 00000100:00100000:3.0:1788839296.325984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839296.325990:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747120000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.326024:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747120000:12345-0@lo:400:kworker.0 Request processed in 33us (8526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839296.326030:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839296.326084:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788839296.326091:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747120384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.326119:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747120384:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839296.326125:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788839296.326143:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839296.326170:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747119872:0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.326184:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747120384:0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.328731:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747120128:0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.328812:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839296.328864:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120128 00000100:00100000:3.0:1788839296.328870:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120128 00000100:00100000:3.0:1788839296.328911:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839296.328920:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747120128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.328973:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747120128:12345-0@lo:400:kworker.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839296.328979:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788839296.328997:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839296.329021:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747120128:0@lo:400:kworker.0 00000100:00100000:0.0:1788839296.338733:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839296.338935:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120256 00000100:00100000:3.0:1788839296.338946:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120256 00000100:00100000:3.0:1788839296.339019:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788839296.339041:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747120256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839296.339131:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747120256:12345-0@lo:400:kworker.0 Request processed in 103us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839296.339156:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788839296.344025:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788839296.344168:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10754000 x1875733747120256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839296.344189:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747120256:0@lo:400:kworker.0 00000100:00100000:1.0:1788839296.362830:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839296.362902:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120512 00000100:00100000:1.0:1788839296.362928:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120512 00000100:00100000:1.0:1788839296.363002:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839296.363013:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747120512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839296.363171:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747120512:12345-0@lo:400:kworker.0 Request processed in 159us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839296.363179:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788839296.363205:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788839296.363250:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33769c00 x1875733747120512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839296.363265:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747120512:0@lo:400:kworker.0 00000100:00100000:1.0:1788839296.363297:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747120000:0@lo:400:kworker.0 00010000:00010000:0.0:1788839296.381670:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839296.829279:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839296.829303:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747120640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839296.829369:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839296.829431:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120640 00000100:00100000:3.0:1788839296.829438:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120640 00000100:00100000:3.0:1788839296.829479:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788839296.829486:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747120640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839296.829517:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839296.829553:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747120640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839296.829560:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788839296.829595:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fcc000 x1875733747120640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839296.829624:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747120640:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788839296.914446:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e05aa00-5dd5-4619-9642-ae49ffaf889b 00000020:00000080:0.0:1788839296.914468:0:6721:0:(genops.c:885:class_export_put()) final put ffff91eb0b856800/8e05aa00-5dd5-4619-9642-ae49ffaf889b 00000020:00000080:2.0:1788839296.914967:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb0b856800/8e05aa00-5dd5-4619-9642-ae49ffaf889b for lustre-OST0000 00000020:00000080:2.0:1788839296.915035:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb0b857000 for lustre-OST0000 00000100:00100000:1.0:1788839297.341264:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839297.341285:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747120768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839297.341356:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839297.341433:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120768 00000100:00100000:1.0:1788839297.341441:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120768 00000100:00100000:1.0:1788839297.341489:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839297.341498:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747120768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839297.341534:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839297.341575:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747120768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839297.341583:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788839297.341624:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33769c00 x1875733747120768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839297.341642:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747120768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788839297.406200:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839298.439075:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839299.464223:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788839299.548045:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e05aa00-5dd5-4619-9642-ae49ffaf889b 00000020:00000080:3.0:1788839299.548080:0:7651:0:(genops.c:885:class_export_put()) final put ffff91eb0b853000/8e05aa00-5dd5-4619-9642-ae49ffaf889b 00000020:00000080:2.0:1788839299.548131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb0b853000/8e05aa00-5dd5-4619-9642-ae49ffaf889b for lustre-OST0001 00000020:00000080:2.0:1788839299.548307:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb0b853800 for lustre-OST0001 00010000:00010000:2.0:1788839300.482336:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839301.182621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839301.182667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839301.182692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839301.183295:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261696 00000100:00100000:3.0:1788839301.183308:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261696 00000100:00100000:3.0:1788839301.183376:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 228 00000100:00100000:3.0:1788839301.183388:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729261696:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839301.183475:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729261696:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 90us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839301.183483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 228 00000100:00100000:3.0:1788839301.183533:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261952 00000100:00100000:3.0:1788839301.183537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261952 00000100:00100000:3.0:1788839301.183575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729261824 00000100:00100000:3.0:1788839301.183579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729261824 00000100:00100000:3.0:1788839301.183600:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:3.0:1788839301.183607:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729261952:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839301.183642:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729261952:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 35us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839301.183649:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:3.0:1788839301.183660:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:3.0:1788839301.183667:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729261824:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839301.183690:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729261824:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 24us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839301.183696:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00080000:3.0:1788839301.187368:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839301.438842:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747120896:0@lo:400:kworker.0 00000100:00100000:2.0:1788839301.438980:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839301.439098:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747120896 00000100:00100000:1.0:1788839301.439108:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747120896 00000100:00100000:2.0:1788839301.439230:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788839301.439242:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747120896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839301.439306:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747120896:12345-0@lo:400:kworker.0 Request processed in 66us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839301.439314:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788839301.439372:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747120896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839301.443255:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839301.443270:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747121152:0@lo:400:kworker.0 00000100:00100000:1.0:1788839301.443277:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747121024:0@lo:400:kworker.0 00000100:00100000:2.0:1788839301.443407:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839301.443417:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747121408:0@lo:400:kworker.0 00000100:00100000:0.0:1788839301.443469:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747121280:0@lo:400:kworker.0 00000100:00100000:1.0:1788839301.443973:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839301.444330:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839301.444381:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121024 00000100:00100000:3.0:1788839301.444391:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121024 00000100:00100000:3.0:1788839301.444441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121152 00000100:00100000:3.0:1788839301.444445:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121152 00000100:00100000:3.0:1788839301.444478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839301.444489:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747121024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839301.445330:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747121024:12345-0@lo:400:kworker.0 Request processed in 836us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839301.445343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839301.445371:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839301.445389:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747121152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839301.445443:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747121152:12345-0@lo:400:kworker.0 Request processed in 57us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839301.445449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788839301.445479:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839301.445532:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747121024:0@lo:400:kworker.0 00000100:00100000:3.0:1788839301.446094:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747121152:0@lo:400:kworker.0 00000100:00100000:2.0:1788839301.446122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839301.446314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121408 00000100:00100000:3.0:1788839301.446322:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121408 00000100:00100000:3.0:1788839301.446367:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839301.446375:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747121408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839301.446426:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747121408:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839301.446434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788839301.446450:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839301.446845:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747121408:0@lo:400:kworker.0 00000100:00100000:2.0:1788839301.446919:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839301.446932:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747121536:0@lo:400:kworker.0 00000100:00100000:2.0:1788839301.446991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839301.447028:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121536 00000100:00100000:2.0:1788839301.447033:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121536 00000100:00100000:2.0:1788839301.447101:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839301.447109:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747121536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839301.447159:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747121536:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839301.447166:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788839301.447185:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839301.447315:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788839301.447320:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40acea00 x1875733747121536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839301.447333:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747121536:0@lo:400:kworker.0 00000100:00100000:0.0:1788839301.447343:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121280 00000100:00100000:0.0:1788839301.447347:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121280 00000100:00100000:0.0:1788839301.450590:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788839301.450617:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747121280:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788839301.450663:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839301.450769:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747121280:12345-0@lo:400:kworker.0 Request processed in 164us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839301.450777:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788839301.451120:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40acfb80 x1875733747121280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839301.451140:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747121280:0@lo:400:kworker.0 00010000:00010000:0.0:1788839301.512160:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839301.954340:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747121664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839301.954447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839301.954585:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121664 00000100:00100000:3.0:1788839301.954595:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121664 00000100:00100000:3.0:1788839301.954652:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839301.954664:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747121664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839301.954716:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839301.954768:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747121664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839301.954776:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788839301.954827:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fcdc00 x1875733747121664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839301.954849:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747121664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839302.461363:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839302.461397:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747121792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839302.461508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839302.461802:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121792 00000100:00100000:1.0:1788839302.461813:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121792 00000100:00100000:1.0:1788839302.461876:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839302.461886:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747121792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839302.461933:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839302.462002:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747121792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839302.462009:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788839302.462155:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8f9500 x1875733747121792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839302.462174:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747121792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788839302.526277:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839303.552500:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839304.578261:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788839304.670506:0:11026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788839305.598023:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839306.300531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839306.300591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839306.300632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839306.302219:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262080 00000100:00100000:2.0:1788839306.302240:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262080 00000100:00100000:2.0:1788839306.302337:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 230 00000100:00100000:2.0:1788839306.302350:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729262080:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839306.302479:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729262080:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 131us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839306.302512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 230 00000100:00100000:2.0:1788839306.302728:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262336 00000100:00100000:2.0:1788839306.302734:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262336 00000100:00100000:2.0:1788839306.302780:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262208 00000100:00100000:2.0:1788839306.302784:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262208 00000100:00100000:2.0:1788839306.302808:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:2.0:1788839306.302815:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729262336:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839306.302860:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729262336:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 45us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839306.302867:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:2.0:1788839306.302893:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:2.0:1788839306.302900:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2356:x1875733729262208:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839306.302927:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2356:x1875733729262208:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 28us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839306.302934:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00080000:2.0:1788839306.302952:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839306.565486:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747122176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839306.565587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839306.565670:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839306.565677:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747122304:0@lo:400:kworker.0 00000100:00100000:1.0:1788839306.565711:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839306.565759:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747122176 00000100:00100000:1.0:1788839306.565768:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747122176 00000100:00100000:1.0:1788839306.565851:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839306.565887:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747122176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839306.565959:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747122176:12345-0@lo:400:kworker.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839306.565969:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839306.566000:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747122304 00000100:00100000:1.0:1788839306.566003:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747122304 00000100:00100000:1.0:1788839306.566044:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839306.566081:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747122304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.566576:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747121920:0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.566634:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839306.566674:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747122432:0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.566702:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839306.566727:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788839306.566736:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747122048:0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.566763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839306.566779:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747122560:0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.566824:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839306.566861:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747122432 00000100:00100000:2.0:1788839306.566867:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747122432 00000100:00100000:2.0:1788839306.566919:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747122048 00000100:00100000:2.0:1788839306.566922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747122048 00000100:00100000:2.0:1788839306.566939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788839306.566948:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747122432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.566997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747122432:12345-0@lo:400:kworker.0 Request processed in 51us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839306.567004:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788839306.567020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788839306.567026:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747122048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.567076:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747122048:12345-0@lo:400:kworker.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839306.567083:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788839306.567242:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747122560 00000100:00100000:0.0:1788839306.567246:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747122560 00000100:00100000:0.0:1788839306.567283:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788839306.567291:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747122560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839306.567331:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747122560:12345-0@lo:400:kworker.0 Request processed in 42us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839306.567337:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839306.568313:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747122048:0@lo:400:kworker.0 00010000:00080000:2.0:1788839306.568338:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb1e5c7b80 x1875733747122560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839306.568351:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747122560:0@lo:400:kworker.0 00000100:00100000:2.0:1788839306.568366:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747122432:0@lo:400:kworker.0 00000100:00100000:1.0:1788839306.568814:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747122304:12345-0@lo:400:kworker.0 Request processed in 2730us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839306.568826:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788839306.568886:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839306.568893:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839306.568897:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839306.568928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747121920 00000100:00100000:1.0:1788839306.568937:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747121920 00010000:00080000:0.0:1788839306.569147:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb1e5c6680 x1875733747122304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839306.569163:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747122304:0@lo:400:kworker.0 00000100:00100000:0.0:1788839306.569202:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747122176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839306.570269:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788839306.570294:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747121920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839306.570429:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747121920:12345-0@lo:400:kworker.0 Request processed in 147us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839306.570437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788839306.570602:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747121920:0@lo:400:kworker.0 00010000:00010000:2.0:1788839306.621489:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839307.075255:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747122688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839307.075337:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839307.075607:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747122688 00000100:00100000:3.0:1788839307.075616:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747122688 00000100:00100000:3.0:1788839307.075663:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839307.075672:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747122688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839307.075710:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839307.075756:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747122688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839307.075762:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788839307.075805:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fcdc00 x1875733747122688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839307.075824:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747122688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839307.581451:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839307.581476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747122816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839307.581550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839307.581666:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747122816 00000100:00100000:1.0:1788839307.581674:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747122816 00000100:00100000:1.0:1788839307.581733:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839307.581744:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747122816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839307.581778:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839307.581826:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747122816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839307.581840:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788839307.581896:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3375ea00 x1875733747122816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839307.581915:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747122816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839307.649724:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839308.671227:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839309.696301:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788839309.735136:0:11174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc85f485c0 20000000:00000080:3.0:1788839309.735164:0:11174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eb33154000 uarg=0000000000000000 20000000:01000000:3.0:1788839309.735217:0:11174:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788839309.735224:0:11174:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788839309.735229:0:11174:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788839309.736873:0:11175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788839309.737300:0:11174:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788839309.758784:0:11174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788839309.758871:0:11174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.758898:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.758909:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fcee expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.758918:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.758925:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.758934:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.758944:0:11174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.759021:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.759043:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 12 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.759145:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747122944:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839309.759304:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.759313:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.759323:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123072:0@lo:104: 00000100:00100000:3.0:1788839309.759376:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839309.759771:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747123072 00000100:00100000:2.0:1788839309.759783:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747123072 00000100:00100000:2.0:1788839309.759862:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839309.759876:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:11174:x1875733747123072:12345-0@lo:104: 00010000:00010000:2.0:1788839309.759905:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839309.766294:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839309.766324:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:11174:x1875733747123072:12345-0@lo:104: Request processed in 6441us (6938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839309.766339:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788839309.766734:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839309.766746:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.766759:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965200 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839309.766764:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.766775:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839309.766783:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839309.766790:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839309.766866:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.766871:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839309.766914:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.766921:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20965200/0x4b63896d6363fd0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.766952:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839309.766954:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839309.766955:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839309.767038:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839309.767085:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747123200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839309.767172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839309.767242:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747123200 00000100:00100000:0.0:1788839309.767252:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747123200 00010000:00010000:0.0:1788839309.767289:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839309.767320:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839309.767330:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747123200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839309.767347:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839309.767352:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.767364:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.767388:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839309.768760:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747123200:12345-0@lo:103:ldlm_bl.0 Request processed in 1419us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839309.768776:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839309.768923:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747123200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839309.773787:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.773826:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 18 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.773846:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123328:0@lo:104: 00000100:00100000:3.0:1788839309.773948:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839309.774198:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747123328 00000100:00100000:1.0:1788839309.774210:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747123328 00000100:00100000:1.0:1788839309.774279:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839309.774292:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:11174:x1875733747123328:12345-0@lo:104: 00010000:00010000:1.0:1788839309.774310:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.774533:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fcee expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.774546:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fcee expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.774557:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123456:0@lo:104: 00010000:00010000:1.0:1788839309.775398:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839309.775413:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2841848a-c637-485f-b8f2-edd7dddc336d+3:11174:x1875733747123328:12345-0@lo:104: Request processed in 1120us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839309.775426:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839309.776941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:0.0:1788839309.777089:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839309.777102:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.777136:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529000 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839309.777140:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.777152:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839309.777159:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839309.777165:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839309.777228:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.777236:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839309.777265:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.777273:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14529000/0x4b63896d6363fcfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.777294:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839309.777296:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839309.777299:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839309.777319:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839309.777344:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747123584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839309.777941:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262464 00000100:00100000:2.0:1788839309.777956:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262464 00000100:00100000:3.0:1788839309.778292:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839309.778381:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.778417:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.778431:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123712:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839309.778503:0:11174:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4300 going to sleep for 11 seconds 00010000:00010000:2.0:1788839309.779122:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839309.779170:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:2.0:1788839309.779182:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729262464:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839309.779200:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839309.779207:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839309.779222:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 13 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839309.779248:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839309.779285:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729262464:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 106us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839309.779292:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:2.0:1788839309.779490:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747123456 00000100:00100000:2.0:1788839309.779499:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747123456 00000100:00100000:0.0:1788839309.779679:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839309.779741:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747123584 00000100:00100000:0.0:1788839309.779745:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747123584 00010000:00010000:0.0:1788839309.779779:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 19 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839309.779803:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839309.779810:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747123584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839309.779831:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839309.779835:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 19 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.779846:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 19 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.779858:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839309.779904:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747123584:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839309.779912:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839309.779953:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747123584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839309.780258:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c7800/0x4b63896d6363fd26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeb2 expref: 12 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.780275:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747122944:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839309.780289:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529200/0x4b63896d6363fd11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fd0a expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.780300:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123072:0@lo:104: 00010000:00010000:3.0:1788839309.780312:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20964e00/0x4b63896d6363fd03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fcfc expref: 17 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.780321:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123328:0@lo:104: 00000100:00100000:2.0:1788839309.781194:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839309.781206:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:11174:x1875733747123456:12345-0@lo:104: 00010000:00010000:2.0:1788839309.781226:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839309.781331:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839309.781338:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:11174:x1875733747123456:12345-0@lo:104: Request processed in 136us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839309.781345:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839309.781443:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123456:0@lo:104: 00010000:00010000:0.0:1788839309.784226:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839309.784250:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.784268:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965a00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839309.784275:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.784288:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839309.784296:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839309.784337:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839309.784418:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.784424:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839309.784467:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.784475:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20965a00/0x4b63896d6363fcee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fcf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839309.784502:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839309.784503:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839309.784505:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839309.784539:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747123840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839309.784635:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839309.785708:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747123840 00000100:00100000:2.0:1788839309.785721:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747123840 00010000:00010000:2.0:1788839309.785770:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fcee expref: 17 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839309.785857:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839309.785869:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2841848a-c637-485f-b8f2-edd7dddc336d+17:3313:x1875733747123840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839309.785885:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839309.785891:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fcee expref: 17 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839309.785906:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fcee expref: 17 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839309.785927:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529800/0x4b63896d6363fcf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fcee expref: 17 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839309.785947:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839309.786868:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2841848a-c637-485f-b8f2-edd7dddc336d+16:3313:x1875733747123840:12345-0@lo:103:ldlm_bl.0 Request processed in 991us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839309.786884:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839309.787027:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747123840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839309.790201:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875733747123712:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839309.790263:0:11174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839309.794580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839309.794747:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262592 00000100:00100000:3.0:1788839309.794760:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262592 00010000:00010000:3.0:1788839309.794824:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 12 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839309.794898:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:3.0:1788839309.794910:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+12:2358:x1875733729262592:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839309.794931:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839309.794939:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 12 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.794954:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 12 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.794992:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fce7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae7a expref: 12 pid: 5838 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795015:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795026:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795073:0:6711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795082:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795088:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795096:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795112:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839309.795118:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795127:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795143:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795155:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839309.795231:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+11:2358:x1875733729262592:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 323us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839309.795240:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00010000:00010000:3.0:1788839309.795277:0:11174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795288:0:11174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839309.795294:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529600/0x4b63896d6363fd42 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839310.717470:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839311.031203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839311.031341:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262720 00000100:00100000:0.0:1788839311.031352:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262720 00000100:00100000:0.0:1788839311.031421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:0.0:1788839311.031439:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+11:5597:x1875733729262720:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839311.031457:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839311.031476:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaedc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.031505:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.031534:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.031544:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6200, rc 0) 00000100:00100000:0.0:1788839311.031602:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729262720:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 166us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839311.031610:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:3.0:1788839311.053299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839311.053580:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262848 00000100:00100000:1.0:1788839311.053590:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262848 00000100:00100000:1.0:1788839311.053650:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 233 00000100:00100000:1.0:1788839311.053661:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729262848:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839311.054552:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729262848:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 890us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.054581:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 233 00000100:00100000:1.0:1788839311.062362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839311.062455:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729262976 00000100:00100000:2.0:1788839311.062466:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729262976 00000100:00100000:2.0:1788839311.062524:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 234 00000100:00100000:2.0:1788839311.062535:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729262976:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.062806:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729262976:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 273us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.062815:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 234 00000100:00100000:2.0:1788839311.080856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839311.081654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729263104 00000100:00100000:3.0:1788839311.081670:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729263104 00000100:00100000:3.0:1788839311.081807:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 235 00000100:00100000:3.0:1788839311.081821:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729263104:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839311.081863:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839311.081888:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaee3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839311.081945:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839311.081961:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839311.081972:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14529c00, rc 0) 00000100:00100000:3.0:1788839311.082095:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729263104:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 276us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839311.082103:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 235 00000100:00100000:3.0:1788839311.085084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839311.085275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729263232 00000100:00100000:1.0:1788839311.085290:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729263232 00000100:00100000:1.0:1788839311.085549:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 236 00000100:00100000:1.0:1788839311.085567:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729263232:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839311.086242:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729263232:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 677us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.086253:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 236 00000100:00100000:2.0:1788839311.088865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839311.089033:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729263360 00000100:00100000:3.0:1788839311.089045:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729263360 00000100:00100000:3.0:1788839311.089247:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 237 00000100:00100000:3.0:1788839311.089260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729263360:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839311.089574:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729263360:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 317us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839311.089583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 237 00000100:00100000:2.0:1788839311.417602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839311.417647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839311.418350:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729263488 00000100:00100000:3.0:1788839311.418366:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729263488 00000100:00100000:3.0:1788839311.418463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729263616 00000100:00100000:3.0:1788839311.418467:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729263616 00000100:00100000:3.0:1788839311.418498:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:3.0:1788839311.418511:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729263488:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839311.418746:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729263488:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 237us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839311.418754:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:1.0:1788839311.418889:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:1.0:1788839311.418902:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729263616:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839311.418934:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729263616:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 37us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.418942:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00080000:0.0:1788839311.419210:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839311.678492:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747124352:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.678594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839311.678820:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788839311.678828:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747123968:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.678862:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839311.678887:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747124480:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.678914:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839311.678942:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747124096:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.678966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839311.678999:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747124608:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.679022:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839311.679042:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839311.679047:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747124224:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.679095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839311.679129:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124352 00000100:00100000:1.0:1788839311.679138:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124352 00000100:00100000:1.0:1788839311.679200:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124608 00000100:00100000:1.0:1788839311.679203:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124608 00000100:00100000:1.0:1788839311.679228:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839311.679238:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747124352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.679299:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747124352:12345-0@lo:400:kworker.0 Request processed in 62us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.679307:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839311.679325:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839311.679333:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747124608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.679363:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747124608:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.679368:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839311.679387:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747123968 00000100:00100000:1.0:1788839311.679391:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747123968 00000100:00100000:1.0:1788839311.679417:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788839311.679424:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+16:3313:x1875733747123968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.679453:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+16:3313:x1875733747123968:12345-0@lo:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.679459:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788839311.679495:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124480 00000100:00100000:1.0:1788839311.679506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124480 00000100:00100000:1.0:1788839311.679538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124096 00000100:00100000:1.0:1788839311.679541:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124096 00000100:00100000:1.0:1788839311.679551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124224 00000100:00100000:1.0:1788839311.679553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124224 00000100:00100000:1.0:1788839311.679566:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839311.679572:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747124480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.679600:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747124480:12345-0@lo:400:kworker.0 Request processed in 29us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.679607:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839311.681255:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788839311.681280:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747124096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.681400:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747124096:12345-0@lo:400:kworker.0 Request processed in 131us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.681407:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788839311.681435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788839311.681444:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747124224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.681476:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747124224:12345-0@lo:400:kworker.0 Request processed in 34us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.681482:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788839311.681531:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839311.681539:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839311.681542:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839311.681608:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747124224:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.682001:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747124096:0@lo:400:kworker.0 00010000:00080000:1.0:1788839311.682020:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3357d180 x1875733747124608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839311.682396:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747124608:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.682454:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747123968:0@lo:400:kworker.0 00000100:00100000:1.0:1788839311.682469:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747124480:0@lo:400:kworker.0 00010000:00080000:1.0:1788839311.682483:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3357ed80 x1875733747124352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839311.682493:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747124352:0@lo:400:kworker.0 00010000:00010000:0.0:1788839311.741383:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788839311.807283:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788839311.807295:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02e9b800 from 7 10000000:01000000:3.0:1788839311.807301:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839311.807368:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839311.807383:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839311.807398:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839311.807434:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747124736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839311.807539:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839311.807635:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839311.807785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124736 00000100:00100000:1.0:1788839311.807796:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124736 00000100:00100000:1.0:1788839311.807876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788839311.807888:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747124736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839311.807906:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839311.807925:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fd57 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839311.807967:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839311.807980:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839311.807991:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9dc00, rc 0) 00000100:00100000:1.0:1788839311.808082:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747124736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.808090:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788839311.815386:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747124736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839311.815428:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839311.815444:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839311.815576:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747124864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839311.815666:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839311.815722:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839311.815820:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124864 00000100:00100000:1.0:1788839311.815835:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124864 00000100:00100000:1.0:1788839311.815897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788839311.815909:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747124864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839311.816283:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747124864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839311.816292:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788839311.816565:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747124864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.816623:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747124992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.816672:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839311.816701:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb337529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839311.816717:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747124992 00000100:00100000:2.0:1788839311.816722:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747124992 00000100:00100000:2.0:1788839311.816750:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788839311.816758:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747124992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.816953:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747124992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.816961:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788839311.817002:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747124992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788839311.817762:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788839311.817845:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788839311.817883:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839311.817895:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.817908:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839311.817920:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839311.817923:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb3bf58000 from 7 10000000:01000000:2.0:1788839311.817927:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839311.817962:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.817971:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.817981:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839311.818002:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.818081:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839311.818108:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33752a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839311.818126:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747125120 00000100:00100000:2.0:1788839311.818131:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747125120 00000100:00100000:2.0:1788839311.818163:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788839311.818172:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747125120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839311.818186:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839311.818201:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.818238:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.818248:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.818258:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965000, rc 0) 00000100:00100000:2.0:1788839311.818292:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747125120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.818299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788839311.818344:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839311.818357:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.818366:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839311.818418:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.818443:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839311.818456:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33752a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839311.818466:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747125248 00000100:00100000:2.0:1788839311.818470:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747125248 00000100:00100000:2.0:1788839311.818488:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788839311.818494:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747125248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.818763:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747125248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.818793:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788839311.818828:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.818857:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.818894:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839311.818907:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33752a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839311.818920:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747125376 00000100:00100000:2.0:1788839311.818923:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747125376 00000100:00100000:2.0:1788839311.818943:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788839311.818948:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747125376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.819145:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747125376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.819152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788839311.819189:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788839311.837659:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788839311.838110:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788839311.838141:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839311.838156:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.838170:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839311.838183:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839311.838187:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02d49000 from 7 10000000:01000000:0.0:1788839311.838191:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839311.838247:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.838256:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.838269:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839311.838326:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839311.838419:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839311.838474:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788839311.838961:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747125504 00000100:00100000:2.0:1788839311.838970:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747125504 00000100:00100000:2.0:1788839311.839033:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788839311.839046:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747125504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839311.839088:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839311.839110:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.839145:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.839157:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839311.839178:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965200, rc 0) 00000100:00100000:2.0:1788839311.839249:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747125504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.839256:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788839311.839457:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839311.839478:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.839488:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839311.839589:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839311.839631:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839311.839658:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788839311.839873:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747125632 00000100:00100000:2.0:1788839311.839879:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747125632 00000100:00100000:2.0:1788839311.839918:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788839311.839993:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747125632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.840365:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747125632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 437us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.840375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788839311.841158:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839311.841222:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839311.841291:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839311.841320:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788839311.841608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747125760 00000100:00100000:2.0:1788839311.841627:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747125760 00000100:00100000:2.0:1788839311.841682:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788839311.841692:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747125760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839311.842220:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747125760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 526us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839311.842228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788839311.842344:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747125760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788839311.843620:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788839311.846259:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788839311.846315:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839311.846332:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839311.846348:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839312.189163:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839312.189187:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747125888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839312.189261:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839312.189439:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747125888 00000100:00100000:1.0:1788839312.189448:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747125888 00000100:00100000:1.0:1788839312.189504:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788839312.189515:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747125888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839312.189549:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839312.189595:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747125888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839312.189603:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788839312.192922:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fcca80 x1875733747125888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839312.192951:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747125888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839312.703680:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747126016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839312.703776:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839312.703874:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126016 00000100:00100000:3.0:1788839312.703882:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126016 00000100:00100000:3.0:1788839312.703942:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839312.703952:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747126016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839312.703988:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839312.709788:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747126016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5827us (6002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839312.709803:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788839312.714294:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40acfb80 x1875733747126016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839312.714323:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747126016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839312.769122:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839313.789518:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839314.816525:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839315.858354:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839315.879470:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788839316.538930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839316.538977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839316.539016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839316.539179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729264000 00000100:00100000:2.0:1788839316.539191:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729264000 00000100:00100000:2.0:1788839316.539264:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729263872 00000100:00100000:2.0:1788839316.539267:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729263872 00000100:00100000:2.0:1788839316.539308:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:2.0:1788839316.539321:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729264000:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839316.539443:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729264000:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 124us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839316.539451:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:2.0:1788839316.539473:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:2.0:1788839316.539479:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729263872:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839316.539505:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729263872:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839316.539511:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00080000:1.0:1788839316.540031:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839316.540217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729263744 00000100:00100000:0.0:1788839316.540224:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729263744 00000100:00100000:0.0:1788839316.540284:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 248 00000100:00100000:0.0:1788839316.540294:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729263744:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839316.540355:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729263744:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 63us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839316.540363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 248 00000100:00100000:2.0:1788839316.797486:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747126144:0@lo:400:kworker.0 00000100:00100000:2.0:1788839316.797597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839316.797777:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126144 00000100:00100000:3.0:1788839316.797789:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126144 00000100:00100000:3.0:1788839316.797857:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788839316.797870:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747126144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839316.797951:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747126144:12345-0@lo:400:kworker.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839316.797960:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788839316.798490:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747126144:0@lo:400:kworker.0 00000100:00100000:3.0:1788839316.798664:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747126272:0@lo:400:kworker.0 00000100:00100000:3.0:1788839316.798734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839316.798844:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126272 00000100:00100000:2.0:1788839316.798850:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126272 00000100:00100000:2.0:1788839316.798904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788839316.798913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747126272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839316.799039:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747126400:0@lo:400:kworker.0 00000100:00100000:0.0:1788839316.799110:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839316.799151:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126400 00000100:00100000:0.0:1788839316.799154:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126400 00000100:00100000:0.0:1788839316.799195:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788839316.799200:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747126400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839316.799248:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747126400:12345-0@lo:400:kworker.0 Request processed in 47us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839316.799256:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788839316.799298:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747126400:0@lo:400:kworker.0 00000100:00080000:0.0:1788839316.799333:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839316.810625:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839316.810650:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747126784:0@lo:400:kworker.0 00000100:00100000:1.0:1788839316.810762:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839316.810834:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126784 00000100:00100000:1.0:1788839316.810845:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126784 00000100:00100000:1.0:1788839316.810937:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788839316.810950:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747126784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839316.811016:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747126784:12345-0@lo:400:kworker.0 Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839316.811081:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788839316.811115:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788839316.811152:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3375fb80 x1875733747126784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839316.811170:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747126784:0@lo:400:kworker.0 00000100:00100000:1.0:1788839316.811197:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747126656:0@lo:400:kworker.0 00000100:00100000:2.0:1788839316.811591:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747126272:12345-0@lo:400:kworker.0 Request processed in 12675us (12852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839316.811602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788839316.811800:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839316.811840:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839316.811849:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747126528:0@lo:400:kworker.0 00000100:00100000:1.0:1788839316.811884:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839316.811977:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126528 00000100:00100000:1.0:1788839316.811984:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126528 00000100:00100000:1.0:1788839316.812033:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788839316.812043:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747126528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839316.812181:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747126528:12345-0@lo:400:kworker.0 Request processed in 139us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839316.812190:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788839316.812213:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839316.812332:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126656 00000100:00100000:2.0:1788839316.812338:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126656 00000100:00100000:2.0:1788839316.812390:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839316.812398:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747126656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839316.812436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747126656:12345-0@lo:400:kworker.0 Request processed in 39us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839316.812459:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788839316.812481:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788839316.812588:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3357d180 x1875733747126528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839316.812604:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747126528:0@lo:400:kworker.0 00000100:00100000:1.0:1788839316.812618:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747126656:0@lo:400:kworker.0 00000100:00100000:3.0:1788839316.821038:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747126272:0@lo:400:kworker.0 00010000:00010000:0.0:1788839316.885158:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839317.309390:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839317.309424:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747126912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839317.309537:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839317.309818:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747126912 00000100:00100000:2.0:1788839317.309829:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747126912 00000100:00100000:2.0:1788839317.309900:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788839317.309912:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747126912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839317.309960:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839317.310039:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747126912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839317.310047:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788839317.310361:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fcf480 x1875733747126912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839317.310385:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747126912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839317.821454:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839317.821489:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747127040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839317.821643:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839317.821801:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127040 00000100:00100000:2.0:1788839317.821812:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127040 00000100:00100000:2.0:1788839317.821882:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788839317.821895:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747127040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839317.821947:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839317.822014:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747127040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839317.822021:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788839317.822286:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40acea00 x1875733747127040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839317.822310:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747127040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839317.885288:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839318.909281:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839319.934184:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839320.957385:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788839321.160646:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:48:40 (1788839320) === 00000100:00100000:1.0:1788839321.605191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839321.605495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839321.605609:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729264128 00000100:00100000:0.0:1788839321.605620:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729264128 00000100:00080000:1.0:1788839321.605896:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839321.606838:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1788839321.606858:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729264128:12345-192.168.201.9@tcp:41:mkdir.0 00000004:00000024:0.0:1788839321.606910:0:8483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788839321.607043:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729264128:12345-192.168.201.9@tcp:41:mkdir.0 Request processed in 192us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839321.607071:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1788839321.607794:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729264256 00000100:00100000:2.0:1788839321.607803:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729264256 00000100:00100000:2.0:1788839321.607850:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:2.0:1788839321.607859:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:9680:x1875733729264256:12345-192.168.201.9@tcp:700:mkdir.0 00000100:00100000:2.0:1788839321.607913:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:9680:x1875733729264256:12345-192.168.201.9@tcp:700:mkdir.0 Request processed in 55us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839321.607920:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:1.0:1788839321.632486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839321.632566:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729264512 00000100:00100000:2.0:1788839321.632611:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729264512 00000100:00100000:2.0:1788839321.632665:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1788839321.632675:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:9680:x1875733729264512:12345-192.168.201.9@tcp:36:mkdir.0 00010000:00010000:2.0:1788839321.632744:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839321.632799:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fc62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae65 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.632817:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280300) 00010000:00010000:2.0:1788839321.632827:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839321.633193:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.633219:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.633229:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.633256:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.633263:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.633270:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839321.634436:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788839321.634452:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.634463:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.634477:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.634484:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839321.634488:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.634497:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.634509:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb03866e00) 00010000:00010000:2.0:1788839321.634512:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839321.634516:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.634522:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fd81 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839321.634538:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000676b91bc reply state 0000000072eb4cda transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839321.634547:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839321.634681:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9680:x1875733729264512:12345-192.168.201.9@tcp:36:mkdir.0 Request processed in 2004us (2201us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788839321.634690:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00010000:00010000:0.0:1788839321.638142:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.638164:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.638173:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.638180:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839321.638218:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.638227:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.638247:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eb03866000) 00010000:00010000:0.0:1788839321.638251:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839321.638256:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.638263:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fd88 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839321.662868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839321.662961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839321.663086:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729264640 00000100:00100000:2.0:1788839321.663096:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729264640 00000100:00100000:2.0:1788839321.663146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 250 00000100:00100000:2.0:1788839321.663156:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729264640:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839321.663269:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729264640:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839321.663277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 250 00000100:00100000:3.0:1788839321.664202:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729264768 00000100:00100000:3.0:1788839321.664210:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729264768 00000100:00100000:3.0:1788839321.664271:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:3.0:1788839321.664280:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729264768:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839321.664338:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729264768:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 59us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839321.664345:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00080000:1.0:1788839321.664472:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839321.673962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839321.675175:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729264896 00000100:00100000:2.0:1788839321.675523:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729264896 00000100:00100000:0.0:1788839321.675707:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:0.0:1788839321.675723:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:9681:x1875733729264896:12345-192.168.201.9@tcp:101:chmod.0 00010000:00010000:0.0:1788839321.675744:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839321.675771:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fd8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaeea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.675838:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fd96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.675853:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fd96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.675865:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fd96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839321.675913:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839321.675918:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839321.675980:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fd96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.676009:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fd8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeea expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.676028:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fd96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeea expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.676038:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280100) 00010000:00010000:0.0:1788839321.676041:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839321.676045:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839321.676163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9681:x1875733729264896:12345-192.168.201.9@tcp:101:chmod.0 Request processed in 444us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839321.676171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1788839321.682397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839321.682470:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729265152 00000100:00100000:3.0:1788839321.682478:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729265152 00000100:00100000:3.0:1788839321.682525:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:3.0:1788839321.682532:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9681:x1875733729265152:12345-192.168.201.9@tcp:36:chmod.0 00010000:00010000:3.0:1788839321.682584:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839321.682707:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fd96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeea expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.682725:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280100) 00010000:00010000:3.0:1788839321.682733:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839321.682754:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.682767:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.682777:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839321.683145:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4aa7a14 reply state 000000000eb6b4f7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839321.683152:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788839321.683160:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788839321.683402:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:9681:x1875733729265152:12345-192.168.201.9@tcp:36:chmod.0 Request processed in 868us (1010us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788839321.683410:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00010000:00010000:2.0:1788839321.689999:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.690029:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.690037:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.690043:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14528200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839321.690088:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.690097:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.690116:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453400) 00010000:00010000:2.0:1788839321.690119:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788839321.690124:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.690130:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fd9d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839321.711335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839321.711454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729265280 00000100:00100000:0.0:1788839321.711465:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729265280 00000100:00100000:0.0:1788839321.711528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:0.0:1788839321.711539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9682:x1875733729265280:12345-192.168.201.9@tcp:101:chown.0 00010000:00010000:0.0:1788839321.711567:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839321.711594:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fda4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaef1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.711679:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6363fdab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.711695:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6363fdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.711706:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6363fdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839321.711750:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839321.711754:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839321.711793:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6363fdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.711821:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fda4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaef1 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.711840:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6363fdab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaef1 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.711850:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839321.711853:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839321.711857:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839321.711934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:9682:x1875733729265280:12345-192.168.201.9@tcp:101:chown.0 Request processed in 396us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839321.711941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1788839321.718641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839321.718754:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729265408 00000100:00100000:0.0:1788839321.718764:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729265408 00000100:00100000:0.0:1788839321.718828:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1788839321.718840:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:9682:x1875733729265408:12345-192.168.201.9@tcp:101:chown.0 00010000:00010000:0.0:1788839321.718861:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839321.718884:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaef8 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.718958:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.718994:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719005:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719020:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719028:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719035:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719159:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fdc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719167:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719175:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839321.719225:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839321.719230:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839321.719259:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719271:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719291:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719298:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719306:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839321.719310:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719319:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719332:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839321.719335:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839321.719339:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719346:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fdb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719360:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719366:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719372:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719378:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839321.719387:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719394:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719403:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eb08280500) 00010000:00010000:0.0:1788839321.719406:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839321.719409:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719415:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fdc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719447:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaef8 expref: 10 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719460:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fdc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaef8 expref: 9 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.719468:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb08280a00) 00010000:00010000:0.0:1788839321.719471:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839321.719473:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7a00, rc 0) 00000100:00100000:0.0:1788839321.719541:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+9:9682:x1875733729265408:12345-192.168.201.9@tcp:101:chown.0 Request processed in 704us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839321.719549:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1788839321.726754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839321.726846:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729265664 00000100:00100000:0.0:1788839321.726859:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729265664 00000100:00100000:0.0:1788839321.726965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1788839321.726977:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:9682:x1875733729265664:12345-192.168.201.9@tcp:36:chown.0 00010000:00010000:0.0:1788839321.727083:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839321.727111:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fdc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaef8 expref: 9 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.727130:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb08280a00) 00010000:00010000:0.0:1788839321.727141:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839321.727168:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.727183:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.727214:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839321.790531:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788839321.794383:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b658ce7 reply state 00000000f924b57e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839321.794406:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788839321.794689:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788839321.794812:0:5844:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788839321.794878:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9682:x1875733729265664:12345-192.168.201.9@tcp:36:chown.0 Request processed in 67900us (68128us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788839321.794888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00010000:00010000:0.0:1788839321.802749:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.802771:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.802779:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.802785:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839321.802790:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.802798:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.802838:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb08280500) 00010000:00010000:0.0:1788839321.802842:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788839321.802848:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.802854:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839321.852152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839321.852246:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729265792 00000100:00100000:0.0:1788839321.852256:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729265792 00000100:00100000:0.0:1788839321.852321:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:0.0:1788839321.852331:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:9683:x1875733729265792:12345-192.168.201.9@tcp:101:touch.500 00010000:00010000:0.0:1788839321.852357:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839321.852380:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaeff expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839321.855730:0:8483:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3294us 00010000:00010000:2.0:1788839321.888794:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.888820:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.888832:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.888849:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.888856:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.888864:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889298:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fdea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889308:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fdea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889314:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fdea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839321.889336:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788839321.889340:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839321.889387:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fdea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889399:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889406:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889413:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889419:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839321.889424:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889432:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889445:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280600) 00010000:00010000:2.0:1788839321.889448:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839321.889452:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889459:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d6363fddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889470:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889476:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889494:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889499:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965a00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839321.889503:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889510:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889518:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eb03866e00) 00010000:00010000:2.0:1788839321.889520:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839321.889523:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889529:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965a00/0x4b63896d6363fde3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889566:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fdd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeff expref: 8 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889594:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fdea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeff expref: 7 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.889609:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:2.0:1788839321.889611:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788839321.889614:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964800, rc 0) 00000100:00100000:2.0:1788839321.889795:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9683:x1875733729265792:12345-192.168.201.9@tcp:101:touch.500 Request processed in 37463us (37656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839321.889815:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:0.0:1788839321.896317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839321.896449:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729266048 00000100:00100000:2.0:1788839321.896459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729266048 00000100:00100000:2.0:1788839321.896547:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:2.0:1788839321.896559:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9683:x1875733729266048:12345-192.168.201.9@tcp:101:touch.500 00010000:00010000:2.0:1788839321.896580:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839321.896608:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fdf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.896895:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.896913:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.896927:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.896957:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.896965:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.896971:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839321.897704:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788839321.897961:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6363fe06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.897980:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6363fe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.897989:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6363fe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898025:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898032:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898040:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898047:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839321.898076:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898084:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898097:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:2.0:1788839321.898100:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839321.898105:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898112:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965600/0x4b63896d6363fdf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839321.898125:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000967fe3b0 reply state 000000004225fc09 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839321.898139:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788839321.898177:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964c00/0x4b63896d6363fdf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf06 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898192:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6363fe06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf06 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.898200:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb03866900) 00010000:00010000:2.0:1788839321.898202:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839321.898204:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb600, rc 0) 00000100:00100000:2.0:1788839321.898281:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+10:9683:x1875733729266048:12345-192.168.201.9@tcp:101:touch.500 Request processed in 1723us (1971us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788839321.898289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00010000:00010000:2.0:1788839321.901292:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.901311:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.901319:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.901325:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839321.901329:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.901337:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.901375:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff91eb03866400) 00010000:00010000:2.0:1788839321.901378:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839321.901384:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839321.901390:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6363fdff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839321.904408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839321.904548:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729266304 00000100:00100000:3.0:1788839321.904558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729266304 00000100:00100000:3.0:1788839321.904650:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:3.0:1788839321.904661:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:9683:x1875733729266304:12345-192.168.201.9@tcp:36:touch.500 00010000:00010000:3.0:1788839321.904794:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839321.904820:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6363fe06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf06 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.904838:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb03866900) 00010000:00010000:3.0:1788839321.904849:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839321.904894:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.904939:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.904948:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839321.905149:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067cb31b9 reply state 000000009e225174 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839321.905159:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839321.905384:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+10:9683:x1875733729266304:12345-192.168.201.9@tcp:36:touch.500 Request processed in 724us (985us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788839321.905391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00010000:00010000:0.0:1788839321.909740:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.909761:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.909769:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.909775:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839321.909780:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.909805:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.909821:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb0c453e00) 00010000:00010000:0.0:1788839321.909825:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839321.909834:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839321.909841:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839321.910720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839321.910793:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729266432 00000100:00100000:3.0:1788839321.910804:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729266432 00000100:00100000:3.0:1788839321.910861:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:3.0:1788839321.910872:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:9683:x1875733729266432:12345-192.168.201.9@tcp:101:touch.500 00010000:00010000:3.0:1788839321.910900:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839321.910925:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fe1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf0d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.911003:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fe1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf0d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.911019:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fe1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf0d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839321.911039:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:3.0:1788839321.911189:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839321.911477:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb14528200, rc 0) 00000100:00100000:3.0:1788839321.911536:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+10:9683:x1875733729266432:12345-192.168.201.9@tcp:101:touch.500 Request processed in 666us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839321.911544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:1.0:1788839321.917189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839321.917240:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729266560 00000100:00100000:1.0:1788839321.917249:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729266560 00000100:00100000:1.0:1788839321.917302:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:1.0:1788839321.917312:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875733729266560:12345-192.168.201.9@tcp:8:touch.500 00010000:00080000:1.0:1788839321.917346:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:1.0:1788839321.917379:0:6697:0:(genops.c:1385:class_connect()) connect: client 07d32060-78a7-4509-9f5d-feb437ccdae6, cookie 0x4b63896d6363fe22 00002000:00100000:1.0:1788839321.917390:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07d32060-78a7-4509-9f5d-feb437ccdae6/ffff91eb3c8f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788839321.917427:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788839321.917680:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788839321.917708:0:6697:0:(import.c:65:import_set_state_nolock()) ffff91eb3c8f4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839321.917779:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2354:x1875733729266560:12345-192.168.201.9@tcp:8:touch.500 Request processed in 466us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839321.917786:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:0.0:1788839321.918764:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747127296:0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.918820:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839321.918870:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747127808:0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.918893:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839321.918922:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839321.918928:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747127424:0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.918949:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839321.918986:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127296 00000100:00100000:0.0:1788839321.918992:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127296 00000100:00100000:0.0:1788839321.919026:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127424 00000100:00100000:0.0:1788839321.919029:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127424 00000100:00100000:0.0:1788839321.919087:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839321.919095:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747127296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.919139:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747127296:12345-0@lo:400:kworker.0 Request processed in 45us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839321.919146:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839321.919171:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788839321.919177:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747127424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.919215:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747127424:12345-0@lo:400:kworker.0 Request processed in 38us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839321.919221:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788839321.919240:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127808 00000100:00100000:0.0:1788839321.919244:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127808 00000100:00100000:0.0:1788839321.919273:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788839321.919279:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747127808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.919310:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747127808:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839321.919316:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788839321.919338:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839321.919343:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839321.919371:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747127424:0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.919382:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747127296:0@lo:400:kworker.0 00010000:00080000:0.0:1788839321.919392:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb36f74000 x1875733747127808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839321.919402:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747127808:0@lo:400:kworker.0 00000100:00100000:2.0:1788839321.919480:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747127168:0@lo:400:kworker.0 00000100:00100000:2.0:1788839321.919517:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839321.919548:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747127680:0@lo:400:kworker.0 00000100:00100000:3.0:1788839321.919567:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747127552:0@lo:400:kworker.0 00000100:00100000:2.0:1788839321.919572:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839321.919594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839321.919623:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127168 00000100:00100000:2.0:1788839321.919628:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127168 00000100:00100000:1.0:1788839321.919733:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127552 00000100:00100000:1.0:1788839321.919738:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127552 00000100:00100000:1.0:1788839321.919769:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788839321.919776:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747127552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839321.919815:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747127552:12345-0@lo:400:kworker.0 Request processed in 40us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839321.919821:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788839321.919840:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788839321.919856:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb36f75180 x1875733747127552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839321.919866:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747127552:0@lo:400:kworker.0 00000100:00100000:2.0:1788839321.919987:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788839321.919996:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747127168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839321.920042:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747127168:12345-0@lo:400:kworker.0 Request processed in 48us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839321.920066:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788839321.920135:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747127168:0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.920287:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127680 00000100:00100000:0.0:1788839321.920291:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127680 00000100:00100000:0.0:1788839321.920330:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788839321.920336:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747127680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839321.920370:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747127680:12345-0@lo:400:kworker.0 Request processed in 34us (796us total) trans 0 rc 0/0 00000100:00080000:1.0:1788839321.920398:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839321.920417:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747127680:0@lo:400:kworker.0 00000100:00100000:1.0:1788839321.922526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839321.922563:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729266688 00000100:00100000:1.0:1788839321.922573:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729266688 00000100:00100000:1.0:1788839321.922654:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:1.0:1788839321.922665:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:0:x1875733729266688:12345-192.168.201.9@tcp:2:touch.500 00000100:00100000:0.0:1788839321.922699:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788839321.923394:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788839321.984515:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788839322.004634:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1788839322.004654:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000100:00100000:1.0:1788839322.004931:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+5:0:x1875733729266688:12345-192.168.201.9@tcp:2:touch.500 Request processed in 82260us (82409us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788839322.004944:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:2.0:1788839322.008311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.009901:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729266944 00000100:00100000:0.0:1788839322.009918:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729266944 00000100:00100000:0.0:1788839322.009994:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1788839322.010006:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+10:9683:x1875733729266944:12345-192.168.201.9@tcp:35:touch.500 00000100:00100000:0.0:1788839322.010436:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+11:9683:x1875733729266944:12345-192.168.201.9@tcp:35:touch.500 Request processed in 431us (2135us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788839322.010443:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:2.0:1788839322.046373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.046522:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729267072 00000100:00100000:0.0:1788839322.046534:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729267072 00000100:00100000:0.0:1788839322.046616:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:0.0:1788839322.046629:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+11:9684:x1875733729267072:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:0.0:1788839322.046653:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839322.046674:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf14 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.046740:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fe30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.046755:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fe30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.046765:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fe30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839322.046800:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839322.046803:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839322.046863:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fe30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.046897:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf14 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.046914:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fe30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf14 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.046922:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:0.0:1788839322.046925:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839322.046929:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:0.0:1788839322.047011:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+12:9684:x1875733729267072:12345-192.168.201.9@tcp:101:rm.0 Request processed in 384us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839322.047018:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:1.0:1788839322.059847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.059954:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729267328 00000100:00100000:0.0:1788839322.059965:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729267328 00000100:00100000:0.0:1788839322.060086:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:0.0:1788839322.060100:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+12:9684:x1875733729267328:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:0.0:1788839322.060122:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839322.060147:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf1b expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839322.060427:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788839322.060775:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf1b expref: 14 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.060796:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839322.060801:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839322.060823:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf1b expref: 14 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.060839:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:2.0:1788839322.062946:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+13:9684:x1875733729267328:12345-192.168.201.9@tcp:101:rm.0 Request processed in 2835us (3096us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788839322.062987:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:2.0:1788839322.067560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.067988:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729267456 00000100:00100000:0.0:1788839322.068002:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729267456 00000100:00100000:0.0:1788839322.068227:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:0.0:1788839322.068239:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+13:9684:x1875733729267456:12345-192.168.201.9@tcp:37:rm.0 00000100:00100000:0.0:1788839322.077131:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+13:9684:x1875733729267456:12345-192.168.201.9@tcp:37:rm.0 Request processed in 8881us (9571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839322.077147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:1.0:1788839322.087533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839322.087698:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729267712 00000100:00100000:2.0:1788839322.087711:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729267712 00000100:00100000:2.0:1788839322.087825:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:2.0:1788839322.087837:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de3d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+13:9684:x1875733729267712:12345-192.168.201.9@tcp:35:rm.0 00000100:00100000:2.0:1788839322.088175:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de3d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:9684:x1875733729267712:12345-192.168.201.9@tcp:35:rm.0 Request processed in 338us (652us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788839322.088182:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:1.0:1788839322.093113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.093200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729267968 00000100:00100000:0.0:1788839322.093210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729267968 00000100:00100000:0.0:1788839322.093307:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:0.0:1788839322.093319:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+14:9684:x1875733729267968:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:0.0:1788839322.093345:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839322.093368:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf22 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.093474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fe4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.093490:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fe4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.093502:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fe4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839322.093513:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788839322.093814:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf22 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.093832:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fe4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf22 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.093841:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:0.0:1788839322.093844:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839322.093848:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7a00, rc 0) 00000100:00100000:0.0:1788839322.093912:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+16:9684:x1875733729267968:12345-192.168.201.9@tcp:101:rm.0 Request processed in 595us (811us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788839322.093920:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:1.0:1788839322.101972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839322.102472:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729268096 00000100:00100000:2.0:1788839322.102484:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729268096 00000100:00100000:2.0:1788839322.102602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:2.0:1788839322.102615:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+16:9684:x1875733729268096:12345-192.168.201.9@tcp:41:rm.0 00000004:00000024:2.0:1788839322.102694:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788839322.102777:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+16:9684:x1875733729268096:12345-192.168.201.9@tcp:41:rm.0 Request processed in 164us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839322.102785:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:1.0:1788839322.105841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839322.105975:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729268224 00000100:00100000:3.0:1788839322.105985:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729268224 00000100:00100000:3.0:1788839322.106084:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:3.0:1788839322.106097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+16:9684:x1875733729268224:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:3.0:1788839322.106123:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839322.106152:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529800/0x4b63896d6363fe5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106247:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106263:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106275:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106291:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106299:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106327:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106434:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6363fe6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106442:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6363fe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106450:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6363fe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839322.106477:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788839322.106482:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839322.106504:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6363fe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106516:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6363fe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106526:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106532:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106540:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106547:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839322.106552:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106568:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106822:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:3.0:1788839322.106826:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839322.106832:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106839:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529000/0x4b63896d6363fe61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106856:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106863:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106869:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106875:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839322.106877:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106884:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106892:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff91eb0c453100) 00010000:00010000:3.0:1788839322.106894:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839322.106897:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106914:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529200/0x4b63896d6363fe68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106950:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14529800/0x4b63896d6363fe5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf29 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106965:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6363fe6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf29 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.106973:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:3.0:1788839322.106975:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839322.106978:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e600, rc 0) 00000100:00100000:3.0:1788839322.107342:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+17:9684:x1875733729268224:12345-192.168.201.9@tcp:101:rm.0 Request processed in 1246us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839322.107351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:1.0:1788839322.116639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.116743:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729268480 00000100:00100000:0.0:1788839322.116756:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729268480 00000100:00100000:0.0:1788839322.116826:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:0.0:1788839322.116841:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+17:9684:x1875733729268480:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:0.0:1788839322.116918:0:8483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788839322.116951:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6363fe6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf29 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.116988:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb14528200/0x4b63896d6363fe1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf0d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117002:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839322.117019:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363fe30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf14 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117027:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:0.0:1788839322.117096:0:8483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839322.117122:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117136:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117145:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117159:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117166:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117173:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117307:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117316:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.117322:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839322.118212:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788839322.118224:0:8483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 304809173588ns, next at 305809171061ns, rc = 0 00010000:00010000:0.0:1788839322.118293:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118318:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118327:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118335:0:8483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118342:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118349:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118381:0:8483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839322.118404:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118410:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118416:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118423:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839322.118427:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118435:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118455:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb08280500) 00010000:00010000:0.0:1788839322.118458:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788839322.118462:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118469:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe84 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118485:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118491:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118496:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118501:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839322.118503:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118509:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118515:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:0.0:1788839322.118518:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839322.118521:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.118526:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839322.118546:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000665c7791 reply state 0000000052860123 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839322.118555:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839322.118662:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+16:9684:x1875733729268480:12345-192.168.201.9@tcp:36:rm.0 Request processed in 1820us (2036us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788839322.118671:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00010000:00010000:3.0:1788839322.118959:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839322.118980:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.118987:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839322.118991:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.118999:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.119009:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eb08280500) 00010000:00010000:3.0:1788839322.119012:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788839322.119022:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.119028:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363fe8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839322.119043:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839322.119045:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839322.119081:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839322.122112:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839322.122141:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839322.122149:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839322.122154:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839322.122173:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839322.122194:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839322.122211:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff91eb08280a00) 00010000:00010000:2.0:1788839322.122215:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839322.122220:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839322.122227:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363fe7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839322.127365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.127572:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729268736 00000100:00100000:0.0:1788839322.127603:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729268736 00000100:00100000:0.0:1788839322.127686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:0.0:1788839322.127700:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+15:9684:x1875733729268736:12345-192.168.201.9@tcp:35:rm.0 00000100:00100000:0.0:1788839322.128095:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+16:9684:x1875733729268736:12345-192.168.201.9@tcp:35:rm.0 Request processed in 395us (747us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788839322.128103:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:1.0:1788839322.132883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839322.133894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729268992 00000100:00100000:0.0:1788839322.134257:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729268992 00000100:00100000:0.0:1788839322.134334:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:0.0:1788839322.134346:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+16:9684:x1875733729268992:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:0.0:1788839322.134415:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788839322.134443:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7a00/0x4b63896d6363fe4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf22 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6363fdea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeff expref: 15 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134477:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb03866500) 00010000:00010000:0.0:1788839322.134510:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6363fdab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaef1 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134519:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839322.134526:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839322.134551:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134564:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134752:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134771:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134779:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839322.134787:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.135548:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.135561:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.135570:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839322.136876:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788839322.137303:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137315:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137323:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137344:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839322.137348:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137355:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137372:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839322.137376:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788839322.137380:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137386:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fea0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137413:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137420:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137427:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137431:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839322.137434:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137441:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137460:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280700) 00010000:00010000:1.0:1788839322.137463:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839322.137466:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.137471:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363fe92 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839322.137486:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3057ec reply state 0000000099fd9414 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839322.137496:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839322.137916:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+15:9684:x1875733729268992:12345-192.168.201.9@tcp:36:rm.0 Request processed in 3553us (5022us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788839322.137928:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00010000:00010000:1.0:1788839322.164323:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.164345:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.164354:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.164360:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839322.164365:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.164374:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.164427:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eb08280800) 00010000:00010000:1.0:1788839322.164430:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839322.164436:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839322.164442:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fe99 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839322.429413:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839322.429439:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747127936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839322.429530:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839322.429864:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747127936 00000100:00100000:2.0:1788839322.429874:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747127936 00000100:00100000:2.0:1788839322.430173:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839322.430185:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747127936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839322.430242:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839322.430306:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747127936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839322.430312:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788839322.430386:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb09fcf480 x1875733747127936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839322.430406:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747127936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839322.946602:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747128064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839322.946679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839322.947124:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128064 00000100:00100000:2.0:1788839322.947132:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128064 00000100:00100000:2.0:1788839322.947235:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839322.947248:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747128064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839322.947273:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839322.947333:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747128064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839322.947361:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788839322.947436:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb40ace300 x1875733747128064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839322.947454:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747128064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788839323.021556:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839324.062990:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839325.056279:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839326.081550:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839326.775791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839326.775839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839326.775992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729269120 00000100:00100000:3.0:1788839326.776003:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729269120 00000100:00100000:3.0:1788839326.776118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 252 00000100:00100000:3.0:1788839326.776130:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729269120:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839326.776218:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729269120:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 92us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839326.776226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 252 00000100:00100000:1.0:1788839326.776865:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729269376 00000100:00100000:1.0:1788839326.776871:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729269376 00000100:00100000:1.0:1788839326.776926:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:1.0:1788839326.776948:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729269376:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839326.776997:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729269376:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 63us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839326.777020:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00080000:2.0:1788839326.777486:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839326.779785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839326.779831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839326.779930:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729269248 00000100:00100000:2.0:1788839326.779953:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729269248 00000100:00100000:2.0:1788839326.780008:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729269504 00000100:00100000:2.0:1788839326.780011:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729269504 00000100:00100000:2.0:1788839326.780032:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:2.0:1788839326.780041:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2356:x1875733729269248:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839326.780170:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2356:x1875733729269248:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 130us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839326.780177:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:2.0:1788839326.780194:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:2.0:1788839326.780201:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729269504:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839326.780239:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729269504:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 38us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839326.780245:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00080000:3.0:1788839326.780453:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839327.037298:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747128448:0@lo:400:kworker.0 00000100:00100000:0.0:1788839327.037375:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839327.037432:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788839327.037438:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747128320:0@lo:400:kworker.0 00000100:00100000:0.0:1788839327.037477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839327.037496:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747128832:0@lo:400:kworker.0 00000100:00100000:0.0:1788839327.037532:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839327.037563:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128448 00000100:00100000:0.0:1788839327.037571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128448 00000100:00100000:0.0:1788839327.037618:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128320 00000100:00100000:0.0:1788839327.037621:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128320 00000100:00100000:0.0:1788839327.037642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788839327.037651:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747128448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839327.037703:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747128448:12345-0@lo:400:kworker.0 Request processed in 53us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839327.037711:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788839327.037726:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839327.037732:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747128320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839327.037758:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747128320:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839327.037764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839327.037798:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747128320:0@lo:400:kworker.0 00000100:00100000:0.0:1788839327.037807:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747128448:0@lo:400:kworker.0 00000100:00100000:1.0:1788839327.038147:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747128576:0@lo:400:kworker.0 00000100:00100000:1.0:1788839327.038178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839327.038204:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788839327.038210:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747128192:0@lo:400:kworker.0 00000100:00100000:1.0:1788839327.038235:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839327.038252:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747128704:0@lo:400:kworker.0 00000100:00100000:1.0:1788839327.038273:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839327.038298:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128832 00000100:00100000:1.0:1788839327.038302:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128832 00000100:00100000:1.0:1788839327.038328:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128576 00000100:00100000:1.0:1788839327.038330:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128576 00000100:00100000:1.0:1788839327.038350:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788839327.038357:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747128832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839327.038391:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747128832:12345-0@lo:400:kworker.0 Request processed in 35us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839327.038397:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788839327.038410:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788839327.038416:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747128576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839327.038442:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747128576:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839327.038447:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788839327.038463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128704 00000100:00100000:1.0:1788839327.038466:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128704 00000100:00100000:1.0:1788839327.038484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839327.038491:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747128704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839327.038541:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747128704:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839327.038547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839327.038588:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747128704:0@lo:400:kworker.0 00010000:00080000:1.0:1788839327.038600:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb36f75500 x1875733747128576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839327.038610:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747128576:0@lo:400:kworker.0 00010000:00080000:1.0:1788839327.038640:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb36f77b80 x1875733747128832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839327.038649:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747128832:0@lo:400:kworker.0 00000100:00100000:2.0:1788839327.038765:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128192 00000100:00100000:2.0:1788839327.038770:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128192 00000100:00100000:2.0:1788839327.038805:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788839327.038812:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747128192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839327.038850:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747128192:12345-0@lo:400:kworker.0 Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839327.038856:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788839327.038886:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747128192:0@lo:400:kworker.0 00000100:00080000:3.0:1788839327.039015:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839327.039021:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839327.039023:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788839327.104665:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839327.162513:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1788839327.162531:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788839327.162559:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1788839327.162777:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839327.162799:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747128960:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788839327.162870:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839327.163040:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747128960 00000100:00100000:0.0:1788839327.163078:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747128960 00000100:00100000:0.0:1788839327.163127:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788839327.163138:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747128960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788839327.163166:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788839327.163198:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f859a, atime: 0x6a9f859a, ctime: 0x6a9f859a, blocks: 0x1 00010000:00010000:0.0:1788839327.163232:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839327.163248:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1788839327.163253:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839327.163259:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839327.163277:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839327.163287:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839327.163295:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839327.163320:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788839327.163842:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747128960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 704us (970us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788839327.163851:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788839327.163894:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb40acea00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788839327.163900:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747128960:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788839327.164128:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839327.164136:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839327.164158:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839327.164162:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839327.164173:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839327.164194:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839327.164212:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6363fea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839327.164234:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839327.164236:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839327.164238:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839327.550957:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839327.550982:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747129088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839327.551087:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839327.551287:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747129088 00000100:00100000:1.0:1788839327.551296:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747129088 00000100:00100000:1.0:1788839327.551354:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839327.551364:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747129088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839327.551400:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839327.551442:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747129088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839327.551449:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788839327.551568:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3c8c7800 x1875733747129088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839327.551600:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747129088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839328.062794:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747129216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839328.062873:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839328.062945:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747129216 00000100:00100000:1.0:1788839328.062952:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747129216 00000100:00100000:1.0:1788839328.063002:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839328.063009:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747129216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839328.063071:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839328.063115:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747129216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839328.063122:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839328.063168:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747129216:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788839328.081274:0:11622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788839328.126332:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839329.156774:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788839329.814342:0:11671:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec15b3430 20000000:00000080:1.0:1788839329.814359:0:11671:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eb37104400 uarg=0000000000000000 20000000:01000000:1.0:1788839329.814392:0:11671:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788839329.814399:0:11671:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788839329.814404:0:11671:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788839329.815583:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788839329.815736:0:11671:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788839329.819002:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788839329.819407:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788839329.819559:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788839329.819580:0:11671:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788839329.819599:0:11671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819618:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819626:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819634:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819640:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819652:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819659:0:11671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819699:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819715:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 18 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.819729:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129344:0@lo:104: 00000100:00100000:1.0:1788839329.819791:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839329.819840:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747129344 00000100:00100000:2.0:1788839329.819849:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747129344 00010000:00010000:1.0:1788839329.819853:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.819863:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 18 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.819872:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129472:0@lo:104: 00000100:00100000:1.0:1788839329.819896:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839329.820207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747129472 00000100:00100000:2.0:1788839329.820212:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747129472 00010000:00010000:1.0:1788839329.820225:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.820236:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 18 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839329.820238:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839329.820253:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+4:11671:x1875733747129344:12345-0@lo:104: 00000100:00100000:1.0:1788839329.820253:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129600:0@lo:104: 00010000:00010000:2.0:1788839329.820268:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.820287:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839329.820310:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.820321:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 12 pid: 5837 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.820331:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129728:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839329.820333:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839329.820341:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+4:11671:x1875733747129344:12345-0@lo:104: Request processed in 92us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839329.820350:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839329.820373:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788839329.820386:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747129600 00010000:00010000:1.0:1788839329.820387:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839329.820391:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747129600 00010000:00010000:1.0:1788839329.820399:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.820408:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129856:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839329.820412:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839329.820422:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+4:11671:x1875733747129472:12345-0@lo:104: 00010000:00010000:2.0:1788839329.820431:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.820436:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788839329.820510:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839329.820516:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+4:11671:x1875733747129472:12345-0@lo:104: Request processed in 96us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839329.820523:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788839329.820533:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839329.820543:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839329.820546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788839329.820555:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1a36c20) 00000100:00100000:2.0:1788839329.820557:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:11671:x1875733747129600:12345-0@lo:104: 10000000:00010000:0.0:1788839329.820561:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839329.820579:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820580:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839329.820600:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839329.820606:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788839329.820621:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839329.820628:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2841848a-c637-485f-b8f2-edd7dddc336d+3:11671:x1875733747129600:12345-0@lo:104: Request processed in 74us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839329.820635:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788839329.820638:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820647:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839329.820670:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820678:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb102c7e00/0x4b63896d6363fd73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820690:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839329.820700:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820706:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964e00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839329.820709:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820715:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839329.820722:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839329.820726:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839329.820739:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820744:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839329.820750:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820755:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20964e00/0x4b63896d6363fd65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd6c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820763:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839329.820766:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820771:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14529600 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839329.820774:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820791:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839329.820797:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839329.820802:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839329.820814:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820820:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839329.820843:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820851:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14529600/0x4b63896d6363fd57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d6363fd5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839329.820863:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839329.820865:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839329.820866:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839329.820988:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839329.821005:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747130240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839329.821027:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747129984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839329.821041:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839329.821088:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839329.821116:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839329.821123:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747130112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839329.821147:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839329.821623:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747130240 00000100:00100000:3.0:1788839329.821630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747130240 00010000:00010000:3.0:1788839329.821662:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 19 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839329.821687:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747129984 00000100:00100000:3.0:1788839329.821690:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747129984 00010000:00010000:3.0:1788839329.821702:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 20 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839329.821718:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747130112 00000100:00100000:3.0:1788839329.821730:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747130112 00010000:00010000:3.0:1788839329.821743:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 21 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839329.821758:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839329.821766:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+21:3313:x1875733747130240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839329.821777:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839329.821782:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 21 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.821791:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 21 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.821809:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839329.821843:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+21:3313:x1875733747130240:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839329.821850:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839329.821864:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839329.821870:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+20:3311:x1875733747129984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839329.821877:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839329.821881:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 20 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.821891:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 20 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.821901:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839329.821924:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+20:3311:x1875733747129984:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839329.822006:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839329.822026:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839329.822033:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747130112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839329.822041:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839329.822046:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 19 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.822078:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 19 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.822089:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839329.822116:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747130112:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839329.822123:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788839329.822228:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20965200/0x4b63896d6363fd7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fd73 expref: 18 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.822239:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129344:0@lo:104: 00010000:00010000:1.0:1788839329.822250:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20965000/0x4b63896d6363fd6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fd65 expref: 17 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.822257:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129472:0@lo:104: 00010000:00010000:1.0:1788839329.822266:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9dc00/0x4b63896d6363fd5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d6363fd57 expref: 16 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839329.822273:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129600:0@lo:104: 00000100:00100000:3.0:1788839329.822363:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747130240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839329.822391:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747130112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839329.822412:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747129984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839329.824271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839329.824313:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729269632 00000100:00100000:3.0:1788839329.824322:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729269632 00000100:00100000:1.0:1788839329.824334:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129728:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839329.824358:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1875733747129856:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839329.824359:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 13 pid: 5837 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.824393:0:11671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839329.824411:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1788839329.824422:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2358:x1875733729269632:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839329.824440:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839329.824465:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 13 pid: 5837 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.824488:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 13 pid: 5837 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.824503:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529c00/0x4b63896d6363fd50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaee3 expref: 13 pid: 5837 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.824517:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839329.824570:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7913c62c-0094-46f9-ba19-31fffcffa164+12:2358:x1875733729269632:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 150us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839329.824578:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:0.0:1788839329.826769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839329.826876:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729269760 00000100:00100000:3.0:1788839329.826886:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729269760 00010000:00010000:3.0:1788839329.826921:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839329.827731:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:3.0:1788839329.827745:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7913c62c-0094-46f9-ba19-31fffcffa164+12:2358:x1875733729269760:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839329.827760:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839329.827766:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827779:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827795:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6200/0x4b63896d6363fd49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaedc expref: 12 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827811:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827826:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827841:0:8458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827848:0:8458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827856:0:8458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827863:0:8458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827869:0:8458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839329.827874:0:8458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.827881:0:8458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.827972:0:11671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839329.827983:0:11671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.828213:0:8458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.828223:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9ce00/0x4b63896d6363feae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839329.828236:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839329.828286:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7913c62c-0094-46f9-ba19-31fffcffa164+11:2358:x1875733729269760:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 545us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839329.828302:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00010000:00010000:0.0:1788839330.173351:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788839330.877188:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839330.877197:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02e9b800 from 7 10000000:01000000:0.0:1788839330.877202:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839330.877256:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839330.877269:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839330.877292:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839330.877448:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747130368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.877528:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839330.877838:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839330.877999:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747130368 00000100:00100000:2.0:1788839330.878009:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747130368 00000100:00100000:2.0:1788839330.878093:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788839330.878103:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+16:5840:x1875733747130368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839330.878115:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839330.878242:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09eba000/0x4b63896d6363febc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363feb5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.878269:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09eba000/0x4b63896d6363febc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363feb5 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.878469:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09eba000/0x4b63896d6363febc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363feb5 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.878480:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba000, rc 0) 00000100:00100000:2.0:1788839330.878534:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747130368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 432us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839330.878541:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788839330.878698:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747130368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839330.878714:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839330.878723:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839330.878785:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747130496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.878812:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839330.878897:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839330.878935:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747130496 00000100:00100000:1.0:1788839330.878939:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747130496 00000100:00100000:1.0:1788839330.879000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788839330.879010:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747130496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839330.879295:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747130496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839330.879302:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788839330.879464:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747130496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839330.879502:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747130624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839330.879536:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839330.879892:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839330.879952:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747130624 00000100:00100000:0.0:1788839330.879957:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747130624 00000100:00100000:0.0:1788839330.879979:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788839330.879985:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747130624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.880168:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747130624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839330.880176:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788839330.880331:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747130624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839330.880907:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11684:1875733747130752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839330.880947:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839330.880980:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839330.881039:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747130752 00000100:00100000:0.0:1788839330.881044:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747130752 00000100:00100000:0.0:1788839330.881087:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788839330.881095:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:11684:x1875733747130752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839330.881232:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:11684:x1875733747130752:12345-0@lo:502:llog_process_th.0 Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839330.881240:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788839330.881574:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11684:1875733747130752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839330.881600:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839330.881610:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839330.881612:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788839330.881627:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eb02e9b800 00000020:00000080:2.0:1788839330.881629:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788839330.881700:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11684:1875733747130880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839330.881733:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839330.881755:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839330.882714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747130880 00000100:00100000:2.0:1788839330.882722:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747130880 00000100:00100000:2.0:1788839330.882755:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788839330.882763:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:11684:x1875733747130880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839330.882983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:11684:x1875733747130880:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839330.882991:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788839330.883081:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11684:1875733747130880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839330.883142:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839330.883154:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839330.883156:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788839330.883160:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788839330.883295:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788839330.883669:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839330.883680:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.883691:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839330.883703:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839330.883705:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb3bf58000 from 7 10000000:01000000:2.0:1788839330.883708:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839330.883739:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.883747:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.883756:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839330.883778:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839330.883817:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839330.883850:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839330.883867:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131008 00000100:00100000:2.0:1788839330.883871:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131008 00000100:00100000:2.0:1788839330.883890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788839330.883896:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+17:5840:x1875733747131008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839330.883905:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839330.883926:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09ebb400/0x4b63896d6363feca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fec3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.883948:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09ebb400/0x4b63896d6363feca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fec3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.883959:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09ebb400/0x4b63896d6363feca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fec3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.883967:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb400, rc 0) 00000100:00100000:2.0:1788839330.884008:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747131008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839330.884016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788839330.884079:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839330.884092:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.884101:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839330.884146:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839330.884172:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839330.884210:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839330.884285:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131136 00000100:00100000:3.0:1788839330.884291:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131136 00000100:00100000:3.0:1788839330.884401:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788839330.884410:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747131136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839330.884768:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747131136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839330.884776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788839330.884816:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839330.884853:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839330.885044:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839330.885101:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839330.885128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131264 00000100:00100000:3.0:1788839330.885132:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131264 00000100:00100000:3.0:1788839330.885154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788839330.885162:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747131264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839330.886225:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747131264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1060us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839330.886234:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788839330.886299:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839330.891543:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11685:1875733747131392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839330.892485:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839330.892544:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839330.893754:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131392 00000100:00100000:3.0:1788839330.893765:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131392 00000100:00100000:3.0:1788839330.893824:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788839330.893834:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:11685:x1875733747131392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839330.894091:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+18:11685:x1875733747131392:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839330.894099:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788839330.895768:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11685:1875733747131392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839330.895817:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839330.895836:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839330.895839:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788839330.895845:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eb3bf58000 00000020:00000080:2.0:1788839330.895848:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788839330.895929:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11685:1875733747131520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839330.895986:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839330.899865:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839330.907887:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131520 00000100:00100000:1.0:1788839330.907902:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131520 00000100:00100000:1.0:1788839330.907974:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788839330.907984:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+18:11685:x1875733747131520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839330.913272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+18:11685:x1875733747131520:12345-0@lo:502:llog_process_th.0 Request processed in 5278us (17274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839330.913300:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788839330.914950:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11685:1875733747131520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839330.915005:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839330.915015:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839330.915017:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788839330.915022:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788839330.916240:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788839330.916273:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839330.916293:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839330.916306:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839330.916326:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788839330.916329:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb02d49000 from 7 10000000:01000000:3.0:1788839330.916332:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839330.916367:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839330.916375:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839330.916386:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839330.916409:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839330.916585:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839330.916632:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839330.917495:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131648 00000100:00100000:2.0:1788839330.917505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131648 00000100:00100000:2.0:1788839330.917567:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788839330.917577:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+18:5840:x1875733747131648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839330.917592:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839330.917607:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09ebac00/0x4b63896d6363fed8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d6363fed1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.917634:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09ebac00/0x4b63896d6363fed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d6363fed1 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.917644:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09ebac00/0x4b63896d6363fed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d6363fed1 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.917652:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebac00, rc 0) 00000100:00100000:2.0:1788839330.917709:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747131648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839330.917717:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788839330.922592:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839330.922619:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839330.922632:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839330.922716:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.922783:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839330.922835:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839330.923516:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131776 00000100:00100000:2.0:1788839330.923524:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131776 00000100:00100000:2.0:1788839330.923579:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788839330.923588:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747131776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839330.923898:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747131776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839330.923907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788839330.927331:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.927398:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.927477:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839330.927515:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839330.927533:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747131904 00000100:00100000:0.0:1788839330.927538:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747131904 00000100:00100000:0.0:1788839330.927578:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788839330.927588:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747131904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.927769:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:5840:x1875733747131904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839330.927777:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788839330.927823:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2841848a-c637-485f-b8f2-edd7dddc336d:5840:1875733747131904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839330.927935:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11689:1875733747132032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839330.927964:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839330.927980:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132032 00000100:00100000:0.0:1788839330.927983:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132032 00000100:00100000:0.0:1788839330.928000:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788839330.928005:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:11689:x1875733747132032:12345-0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788839330.928100:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788839330.928138:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:11689:x1875733747132032:12345-0@lo:502:llog_process_th.0 Request processed in 131us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839330.928144:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788839330.928174:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839330.928185:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11689:1875733747132032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839330.928204:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839330.928213:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839330.928218:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839330.928226:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eb02d49000 00000020:00000080:0.0:1788839330.928228:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788839330.929022:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11689:1875733747132160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839330.930781:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839330.931307:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1079d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839330.931407:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132160 00000100:00100000:2.0:1788839330.931417:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132160 00000100:00100000:2.0:1788839330.931487:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788839330.931499:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:11689:x1875733747132160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839330.931859:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:11689:x1875733747132160:12345-0@lo:502:llog_process_th.0 Request processed in 360us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839330.931867:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788839330.932178:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2841848a-c637-485f-b8f2-edd7dddc336d:11689:1875733747132160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839330.932218:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839330.932231:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839330.932233:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788839330.932242:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788839330.932460:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788839330.932480:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839330.932491:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839330.932501:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839331.204800:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839331.767276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839331.767694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729269888 00000100:00100000:3.0:1788839331.767706:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729269888 00000100:00100000:3.0:1788839331.767824:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 269 00000100:00100000:3.0:1788839331.767837:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+11:5597:x1875733729269888:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839331.767872:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839331.767892:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6fc00/0x4b63896d6363fedf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf30 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839331.767924:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6fc00/0x4b63896d6363fedf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf30 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839331.767935:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6fc00/0x4b63896d6363fedf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf30 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839331.767945:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6fc00, rc 0) 00000100:00100000:3.0:1788839331.768006:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729269888:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 173us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839331.768013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 269 00000100:00100000:0.0:1788839331.773678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839331.773789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270016 00000100:00100000:2.0:1788839331.773799:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270016 00000100:00100000:2.0:1788839331.773885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 270 00000100:00100000:2.0:1788839331.773897:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729270016:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839331.775413:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729270016:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 1513us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839331.775435:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 270 00000100:00100000:0.0:1788839331.780563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839331.780922:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270144 00000100:00100000:3.0:1788839331.780935:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270144 00000100:00100000:3.0:1788839331.781701:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 271 00000100:00100000:3.0:1788839331.781717:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729270144:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839331.782232:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729270144:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 520us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839331.782241:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 271 00000100:00100000:0.0:1788839331.791161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839331.791413:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270272 00000100:00100000:2.0:1788839331.791444:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270272 00000100:00100000:2.0:1788839331.791512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 272 00000100:00100000:2.0:1788839331.791523:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+12:9956:x1875733729270272:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839331.791773:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+12:9956:x1875733729270272:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 251us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839331.791782:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 272 00000100:00100000:0.0:1788839331.799367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839331.799542:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270400 00000100:00100000:3.0:1788839331.799552:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270400 00000100:00100000:3.0:1788839331.799667:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 273 00000100:00100000:3.0:1788839331.799679:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:9956:x1875733729270400:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839331.799938:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+12:9956:x1875733729270400:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 261us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839331.799953:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 273 00000100:00100000:1.0:1788839331.815860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839331.815928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270528 00000100:00100000:0.0:1788839331.815939:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270528 00000100:00100000:0.0:1788839331.815999:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 274 00000100:00100000:0.0:1788839331.816009:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+12:5597:x1875733729270528:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839331.816027:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839331.816047:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fee6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf37 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839331.816119:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf37 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839331.816131:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf37 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839331.816141:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6a00, rc 0) 00000100:00100000:0.0:1788839331.816193:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729270528:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 185us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839331.816217:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 274 00000100:00100000:0.0:1788839331.827689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839331.827764:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270656 00000100:00100000:3.0:1788839331.827774:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270656 00000100:00100000:3.0:1788839331.827827:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 275 00000100:00100000:3.0:1788839331.827839:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729270656:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839331.828169:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729270656:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 332us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839331.828178:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 275 00000100:00100000:1.0:1788839331.832584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839331.834306:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270784 00000100:00100000:2.0:1788839331.834320:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270784 00000100:00100000:2.0:1788839331.834520:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 276 00000100:00100000:2.0:1788839331.834532:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729270784:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839331.834784:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:5597:x1875733729270784:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 254us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839331.834794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 276 00000100:00100000:1.0:1788839331.840978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839331.841088:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729270912 00000100:00100000:0.0:1788839331.841097:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729270912 00000100:00100000:3.0:1788839331.841301:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 277 00000100:00100000:3.0:1788839331.841312:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:9959:x1875733729270912:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839331.841543:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:9959:x1875733729270912:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 234us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839331.841549:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 277 00000100:00100000:0.0:1788839331.843255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839331.843365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271040 00000100:00100000:2.0:1788839331.843372:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271040 00000100:00100000:2.0:1788839331.843410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 278 00000100:00100000:2.0:1788839331.843427:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:9959:x1875733729271040:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839331.843593:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:9959:x1875733729271040:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 175us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839331.843599:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 278 00000100:00100000:1.0:1788839331.895152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839331.895181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839331.895365:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271296 00000100:00100000:2.0:1788839331.895374:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271296 00000100:00100000:2.0:1788839331.895450:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:2.0:1788839331.895461:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729271296:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839331.895524:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729271296:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839331.895541:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00080000:0.0:1788839331.895665:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839331.896096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839331.903024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271168 00000100:00100000:3.0:1788839331.903041:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271168 00000100:00100000:2.0:1788839331.903268:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271424 00000100:00100000:2.0:1788839331.903272:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271424 00000100:00100000:2.0:1788839331.903295:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 111 00000100:00100000:2.0:1788839331.903302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729271168:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839331.903486:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:1.0:1788839331.903494:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729271424:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839331.903551:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729271168:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 249us (8368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839331.903557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 111 00000100:00080000:3.0:1788839331.905206:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839331.906958:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729271424:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 3452us (10850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839331.906973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 112 00000040:00080000:1.0:1788839331.965863:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788839332.162317:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747132416:0@lo:400:kworker.0 00000100:00100000:2.0:1788839332.162375:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839332.162429:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747132928:0@lo:400:kworker.0 00000100:00100000:2.0:1788839332.162458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839332.162498:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839332.162504:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747132544:0@lo:400:kworker.0 00000100:00100000:2.0:1788839332.162526:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839332.162561:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132928 00000100:00100000:2.0:1788839332.162569:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132928 00000100:00100000:2.0:1788839332.162622:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788839332.162630:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747132928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839332.162682:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747132928:12345-0@lo:400:kworker.0 Request processed in 52us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839332.162689:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788839332.162710:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839332.162759:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132416 00000100:00100000:2.0:1788839332.162764:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132416 00000100:00100000:2.0:1788839332.162797:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132544 00000100:00100000:2.0:1788839332.162801:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132544 00000100:00100000:2.0:1788839332.162822:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788839332.162827:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747132416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839332.162851:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747132416:12345-0@lo:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839332.162855:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788839332.162863:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788839332.162866:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747132544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839332.162880:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747132544:12345-0@lo:400:kworker.0 Request processed in 14us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839332.162884:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788839332.162895:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839332.162938:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747132544:0@lo:400:kworker.0 00000100:00100000:2.0:1788839332.162945:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747132416:0@lo:400:kworker.0 00010000:00080000:2.0:1788839332.162952:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb1e5c6680 x1875733747132928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839332.162959:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747132928:0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163356:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747132288:0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163386:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839332.163410:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747132800:0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163444:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839332.163465:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839332.163472:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747132672:0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163489:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839332.163509:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132288 00000100:00100000:0.0:1788839332.163512:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132288 00000100:00100000:0.0:1788839332.163531:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788839332.163535:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747132288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163559:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747132288:12345-0@lo:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839332.163563:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788839332.163587:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747132288:0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163598:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132800 00000100:00100000:0.0:1788839332.163606:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132800 00000100:00100000:0.0:1788839332.163627:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788839332.163631:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747132800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163652:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747132800:12345-0@lo:400:kworker.0 Request processed in 21us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839332.163656:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788839332.163672:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747132800:0@lo:400:kworker.0 00000100:00080000:0.0:1788839332.163682:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839332.163689:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747132672 00000100:00100000:0.0:1788839332.163691:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747132672 00000100:00100000:0.0:1788839332.163710:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839332.163714:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747132672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839332.163759:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747132672:12345-0@lo:400:kworker.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839332.163766:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839332.163789:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747132672:0@lo:400:kworker.0 00000100:00080000:0.0:1788839332.163802:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788839332.217193:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788839332.221350:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839332.669510:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839332.669534:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747133056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839332.669607:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839332.669752:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133056 00000100:00100000:1.0:1788839332.669761:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133056 00000100:00100000:1.0:1788839332.669820:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839332.669830:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747133056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839332.669866:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839332.669919:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747133056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839332.669926:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788839332.670151:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33129500 x1875733747133056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839332.670168:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747133056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839333.181386:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747133184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839333.181520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839333.181728:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133184 00000100:00100000:2.0:1788839333.181737:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133184 00000100:00100000:2.0:1788839333.181795:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839333.181805:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747133184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839333.181844:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839333.187643:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747133184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5826us (6123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839333.187682:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788839333.187870:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788839333.187876:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb40acea00, transno 4294967300 00000100:00100000:3.0:1788839333.187955:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747133184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788839333.247438:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839334.269447:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839335.293451:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839336.317808:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839337.017363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839337.017410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839337.017489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839337.017526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839337.017594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271552 00000100:00100000:1.0:1788839337.017602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271552 00000100:00100000:1.0:1788839337.017653:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 280 00000100:00100000:1.0:1788839337.017664:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729271552:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839337.017734:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729271552:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839337.017740:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 280 00000100:00100000:0.0:1788839337.017995:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271808 00000100:00100000:0.0:1788839337.018016:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271808 00000100:00100000:0.0:1788839337.018086:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:0.0:1788839337.018092:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729271808:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839337.018122:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729271808:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 30us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839337.018128:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00080000:1.0:1788839337.018481:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839337.019099:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271680 00000100:00100000:3.0:1788839337.019106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271680 00000100:00100000:3.0:1788839337.019205:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729271936 00000100:00100000:3.0:1788839337.019209:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729271936 00000100:00100000:2.0:1788839337.019265:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:2.0:1788839337.019275:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729271680:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839337.019352:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729271680:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 78us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839337.019360:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00080000:1.0:1788839337.019695:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839337.019817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:3.0:1788839337.019939:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729271936:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839337.019992:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729271936:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 56us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839337.022353:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:1.0:1788839337.278338:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747133312:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.278398:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839337.278434:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747133824:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.278475:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839337.278494:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839337.278507:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747133696:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.278533:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839337.278580:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747133440:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.278603:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839337.278619:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747133952:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.278640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839337.278657:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839337.278662:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747133568:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.278696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839337.278726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133312 00000100:00100000:1.0:1788839337.278732:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133312 00000100:00100000:1.0:1788839337.278776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788839337.278786:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747133312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279003:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747133312:12345-0@lo:400:kworker.0 Request processed in 218us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839337.279011:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788839337.279047:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133696 00000100:00100000:1.0:1788839337.279070:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133696 00000100:00100000:1.0:1788839337.279104:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133952 00000100:00100000:1.0:1788839337.279108:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133952 00000100:00100000:1.0:1788839337.279139:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788839337.279145:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747133696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279179:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747133696:12345-0@lo:400:kworker.0 Request processed in 34us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839337.279185:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788839337.279195:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839337.279199:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747133952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279221:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747133952:12345-0@lo:400:kworker.0 Request processed in 22us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839337.279225:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839337.279236:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133824 00000100:00100000:1.0:1788839337.279239:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133824 00000100:00100000:1.0:1788839337.279255:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133440 00000100:00100000:1.0:1788839337.279257:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133440 00000100:00100000:1.0:1788839337.279263:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747133568 00000100:00100000:1.0:1788839337.279264:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747133568 00000100:00100000:1.0:1788839337.279273:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788839337.279277:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747133824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279308:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747133824:12345-0@lo:400:kworker.0 Request processed in 30us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839337.279312:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788839337.279320:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788839337.279336:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747133440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279354:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747133440:12345-0@lo:400:kworker.0 Request processed in 19us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839337.279358:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788839337.279365:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788839337.279374:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747133568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279391:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747133568:12345-0@lo:400:kworker.0 Request processed in 18us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839337.279395:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788839337.279417:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839337.279420:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839337.279421:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839337.279441:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747133568:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279447:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747133440:0@lo:400:kworker.0 00010000:00080000:1.0:1788839337.279455:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3312b800 x1875733747133952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839337.279462:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747133952:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279483:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747133696:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279489:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747133312:0@lo:400:kworker.0 00000100:00100000:1.0:1788839337.279495:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747133824:0@lo:400:kworker.0 00010000:00010000:0.0:1788839337.341883:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839337.789479:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747134080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839337.789625:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839337.789688:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134080 00000100:00100000:0.0:1788839337.789697:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134080 00000100:00100000:0.0:1788839337.789752:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788839337.789763:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747134080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839337.789803:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839337.789856:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747134080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839337.789864:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788839337.789887:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3cbee300 x1875733747134080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839337.789909:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747134080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839338.302026:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839338.302072:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747134208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839338.302153:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839338.302336:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134208 00000100:00100000:1.0:1788839338.302345:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134208 00000100:00100000:1.0:1788839338.302403:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839338.302415:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747134208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839338.302451:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839338.302522:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747134208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839338.302538:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788839338.302763:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747134208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788839338.365317:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839339.390329:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839340.418445:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839341.182567:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788839341.437366:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839342.135853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839342.135918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839342.136082:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272192 00000100:00100000:3.0:1788839342.136094:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272192 00000100:00100000:3.0:1788839342.136166:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:3.0:1788839342.136178:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729272192:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839342.136263:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729272192:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839342.136271:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:1.0:1788839342.136394:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272064 00000100:00100000:1.0:1788839342.136399:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272064 00000100:00100000:1.0:1788839342.136445:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 282 00000100:00100000:1.0:1788839342.136453:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729272064:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839342.136480:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729272064:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839342.136487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 282 00000100:00080000:0.0:1788839342.136653:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839342.148918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839342.148961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839342.149085:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272448 00000100:00100000:3.0:1788839342.149096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272448 00000100:00100000:3.0:1788839342.149165:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:3.0:1788839342.149174:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729272448:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839342.149266:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729272448:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839342.149274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00080000:0.0:1788839342.149407:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839342.149958:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272320 00000100:00100000:1.0:1788839342.149964:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272320 00000100:00100000:1.0:1788839342.150013:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1788839342.150022:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2354:x1875733729272320:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:1.0:1788839342.150043:0:9213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fe22 00000100:00080000:1.0:1788839342.150082:0:9213:0:(import.c:65:import_set_state_nolock()) ffff91eb3c8f4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839342.150120:0:9213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1788839342.150302:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788839342.150323:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839342.150661:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+2:2354:x1875733729272320:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 640us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839342.150669:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1788839342.398516:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747134720:0@lo:400:kworker.0 00000100:00100000:3.0:1788839342.398575:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747134336:0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.398600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839342.398713:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747134592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839342.398772:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134720 00000100:00100000:1.0:1788839342.398781:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134720 00000100:00100000:1.0:1788839342.398843:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788839342.398853:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb062bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747134720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.403296:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747134464:0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.403398:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839342.403798:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747134976:0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.403941:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839342.403992:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839342.404103:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134976 00000100:00100000:0.0:1788839342.404111:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134976 00000100:00100000:0.0:1788839342.404165:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839342.404175:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747134976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.404242:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747134976:12345-0@lo:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839342.404249:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788839342.404269:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788839342.404297:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb062bce00 x1875733747134976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839342.404312:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747134976:0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.406391:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134464 00000100:00100000:0.0:1788839342.406405:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134464 00000100:00100000:0.0:1788839342.406464:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788839342.406475:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747134464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.406554:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747134464:12345-0@lo:400:kworker.0 Request processed in 81us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839342.406562:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788839342.406606:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747134464:0@lo:400:kworker.0 00000100:00100000:3.0:1788839342.407411:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839342.407521:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb062be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747134848:0@lo:400:kworker.0 00000100:00100000:3.0:1788839342.407575:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839342.407607:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134848 00000100:00100000:3.0:1788839342.407616:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134848 00000100:00100000:3.0:1788839342.408361:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788839342.408377:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747134848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.408559:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134336 00000100:00100000:0.0:1788839342.408572:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134336 00000100:00100000:0.0:1788839342.408618:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788839342.408645:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747134336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839342.408723:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747134336:12345-0@lo:400:kworker.0 Request processed in 80us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839342.408730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1788839342.409206:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839342.412524:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747134848:12345-0@lo:400:kworker.0 Request processed in 4135us (4930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839342.412543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788839342.413426:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747134848:0@lo:400:kworker.0 00000100:00100000:3.0:1788839342.413478:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747134336:0@lo:400:kworker.0 00000100:00100000:2.0:1788839342.417032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839342.417113:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747134592 00000100:00100000:2.0:1788839342.417122:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747134592 00000100:00100000:2.0:1788839342.417184:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788839342.417194:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747134592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839342.417274:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747134592:12345-0@lo:400:kworker.0 Request processed in 81us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839342.417281:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788839342.417308:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839342.417340:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747134592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839342.418214:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb062bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747134720:12345-0@lo:400:kworker.0 Request processed in 19357us (19611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839342.418225:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839342.418633:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb062bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747134720:0@lo:400:kworker.0 00010000:00010000:1.0:1788839342.462155:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788839342.516415:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:2.0:1788839342.516431:0:6721:0:(genops.c:885:class_export_put()) final put ffff91eb3c8f4000/07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:1.0:1788839342.516507:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3c8f4000/07d32060-78a7-4509-9f5d-feb437ccdae6 for lustre-OST0000 00000020:00000080:1.0:1788839342.516584:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb3c8f4800 for lustre-OST0000 00000100:00100000:2.0:1788839342.910519:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747135104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839342.910622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839342.910962:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747135104 00000100:00100000:1.0:1788839342.910975:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747135104 00000100:00100000:1.0:1788839342.911080:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788839342.911094:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747135104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839342.911144:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839342.911240:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747135104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839342.911248:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788839342.911408:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3cbece00 x1875733747135104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839342.911434:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747135104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839343.421632:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747135232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839343.421818:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839343.422034:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747135232 00000100:00100000:1.0:1788839343.422045:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747135232 00000100:00100000:1.0:1788839343.422138:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788839343.422152:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747135232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839343.422200:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839343.422276:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747135232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839343.422284:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788839343.422347:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747135232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788839343.488834:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839344.509325:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839345.534283:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839346.557313:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839347.264173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839347.264354:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272704 00000100:00100000:0.0:1788839347.264365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272704 00000100:00100000:0.0:1788839347.264446:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:0.0:1788839347.264461:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729272704:12345-192.168.201.9@tcp:400:kworker.0 00000100:00080000:3.0:1788839347.264548:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839347.265017:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729272704:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 559us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839347.265027:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:2.0:1788839347.268459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839347.268546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839347.268756:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272576 00000100:00100000:3.0:1788839347.268766:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272576 00000100:00100000:3.0:1788839347.268832:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 284 00000100:00100000:3.0:1788839347.268844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729272576:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839347.268912:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729272576:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 71us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839347.268920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 284 00000100:00100000:0.0:1788839347.269036:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272832 00000100:00100000:0.0:1788839347.269042:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272832 00000100:00100000:0.0:1788839347.269129:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 127 00000100:00100000:0.0:1788839347.269138:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729272832:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839347.269185:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729272832:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 48us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839347.269191:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 127 00000100:00080000:3.0:1788839347.269991:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839347.517578:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747135488:0@lo:400:kworker.0 00000100:00100000:3.0:1788839347.517709:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839347.517783:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747136000:0@lo:400:kworker.0 00000100:00100000:3.0:1788839347.517815:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839347.517851:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839347.517859:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747135616:0@lo:400:kworker.0 00000100:00100000:3.0:1788839347.517883:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839347.517953:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747135488 00000100:00100000:1.0:1788839347.517962:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747135488 00000100:00100000:1.0:1788839347.518014:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747135616 00000100:00100000:1.0:1788839347.518018:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747135616 00000100:00100000:1.0:1788839347.518081:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788839347.518093:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747135488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839347.518167:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747135488:12345-0@lo:400:kworker.0 Request processed in 76us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839347.518184:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788839347.518203:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788839347.518210:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747135616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839347.518240:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747135616:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839347.518245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788839347.518285:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839347.518531:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747135616:0@lo:400:kworker.0 00000100:00100000:3.0:1788839347.518545:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747135488:0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.518961:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747135744:0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.519001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839347.519041:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788839347.519070:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747135360:0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.519128:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839347.519162:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747135872:0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.519188:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839347.519241:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136000 00000100:00100000:0.0:1788839347.519246:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136000 00000100:00100000:0.0:1788839347.519281:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747135744 00000100:00100000:0.0:1788839347.519285:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747135744 00000100:00100000:0.0:1788839347.519304:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839347.519311:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747136000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.519355:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747136000:12345-0@lo:400:kworker.0 Request processed in 44us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839347.519364:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839347.519377:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839347.519383:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747135744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.519415:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747135744:12345-0@lo:400:kworker.0 Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839347.519420:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839347.519437:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747135360 00000100:00100000:0.0:1788839347.519441:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747135360 00000100:00100000:0.0:1788839347.519463:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788839347.519469:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747135360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.519497:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747135360:12345-0@lo:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839347.519503:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788839347.519543:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747135360:0@lo:400:kworker.0 00000100:00100000:0.0:1788839347.519555:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747135744:0@lo:400:kworker.0 00000100:00080000:1.0:1788839347.520132:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839347.520138:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839347.520164:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747135872 00000100:00100000:1.0:1788839347.520169:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747135872 00010000:00080000:3.0:1788839347.520668:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb10757b80 x1875733747136000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839347.520683:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747136000:0@lo:400:kworker.0 00000100:00080000:3.0:1788839347.520727:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839347.520857:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788839347.520866:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747135872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839347.520933:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747135872:12345-0@lo:400:kworker.0 Request processed in 69us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839347.520942:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788839347.521795:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747135872:0@lo:400:kworker.0 00010000:00010000:1.0:1788839347.581645:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839348.029315:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747136128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839348.029391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839348.029579:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136128 00000100:00100000:1.0:1788839348.029587:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136128 00000100:00100000:1.0:1788839348.029647:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839348.029658:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747136128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839348.029693:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839348.029763:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747136128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839348.029770:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788839348.029911:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3cbef100 x1875733747136128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839348.029930:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747136128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839348.541370:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747136256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839348.541460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839348.541822:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136256 00000100:00100000:3.0:1788839348.541831:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136256 00000100:00100000:3.0:1788839348.541892:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788839348.541902:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747136256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839348.541938:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839348.542201:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747136256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 291us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839348.542210:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788839348.542313:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747136256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839348.609432:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839349.629350:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839350.682693:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839351.423820:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839351.678376:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839352.385101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839352.385147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839352.385213:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729272960 00000100:00100000:2.0:1788839352.385228:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729272960 00000100:00100000:1.0:1788839352.385243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839352.385295:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 286 00000100:00100000:2.0:1788839352.385310:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729272960:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839352.385444:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729272960:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839352.385453:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 286 00000100:00100000:0.0:1788839352.385456:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729273088 00000100:00100000:0.0:1788839352.385462:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729273088 00000100:00100000:0.0:1788839352.385514:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729273216 00000100:00100000:0.0:1788839352.385518:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729273216 00000100:00100000:0.0:1788839352.385542:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 131 00000100:00100000:0.0:1788839352.385550:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729273088:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839352.385590:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729273088:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 42us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839352.385597:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 131 00000100:00100000:0.0:1788839352.385610:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 132 00000100:00100000:0.0:1788839352.385617:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729273216:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839352.385650:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2355:x1875733729273216:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 34us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839352.385657:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 132 00000100:00080000:3.0:1788839352.385734:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839352.639130:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747136768:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639243:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839352.639341:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788839352.639348:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747136384:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639387:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839352.639413:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747136896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639443:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839352.639475:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747136512:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639504:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839352.639525:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747137024:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639548:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839352.639570:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839352.639576:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747136640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839352.639648:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136768 00000100:00100000:1.0:1788839352.639659:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136768 00000100:00100000:1.0:1788839352.639733:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137024 00000100:00100000:1.0:1788839352.639738:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137024 00000100:00100000:1.0:1788839352.639768:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788839352.639781:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747136768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639853:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747136768:12345-0@lo:400:kworker.0 Request processed in 74us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839352.639862:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788839352.639910:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788839352.639917:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747137024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.639954:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747137024:12345-0@lo:400:kworker.0 Request processed in 37us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839352.639960:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788839352.639984:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136384 00000100:00100000:1.0:1788839352.639989:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136384 00000100:00100000:1.0:1788839352.640016:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788839352.640024:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747136384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640091:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747136384:12345-0@lo:400:kworker.0 Request processed in 68us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839352.640098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788839352.640133:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136896 00000100:00100000:1.0:1788839352.640137:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136896 00000100:00100000:1.0:1788839352.640169:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136512 00000100:00100000:1.0:1788839352.640173:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136512 00000100:00100000:1.0:1788839352.640186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747136640 00000100:00100000:1.0:1788839352.640189:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747136640 00000100:00100000:1.0:1788839352.640213:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788839352.640221:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747136896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640256:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747136896:12345-0@lo:400:kworker.0 Request processed in 36us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839352.640263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788839352.640276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788839352.640282:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747136512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747136512:12345-0@lo:400:kworker.0 Request processed in 31us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839352.640332:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788839352.640346:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788839352.640353:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747136640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640385:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747136640:12345-0@lo:400:kworker.0 Request processed in 33us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839352.640391:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788839352.640432:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839352.640438:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839352.640440:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839352.640502:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747136640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640516:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747136512:0@lo:400:kworker.0 00010000:00080000:1.0:1788839352.640532:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3cbeed80 x1875733747137024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839352.640545:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747137024:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640593:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747136384:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640607:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747136896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839352.640616:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747136768:0@lo:400:kworker.0 00010000:00010000:0.0:1788839352.701402:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839353.150271:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747137152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839353.150396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839353.150642:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137152 00000100:00100000:1.0:1788839353.150656:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137152 00000100:00100000:1.0:1788839353.150736:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839353.150749:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747137152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839353.150800:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839353.150879:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747137152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839353.150921:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788839353.151186:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3cbec380 x1875733747137152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839353.151208:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747137152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839353.665233:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747137280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839353.665317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839353.665416:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137280 00000100:00100000:0.0:1788839353.665425:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137280 00000100:00100000:0.0:1788839353.665472:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839353.665483:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747137280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839353.665541:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839353.665595:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747137280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839353.665603:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839353.665655:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747137280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839353.725297:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788839354.374490:0:11853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:49:13 (1788839353) 00010000:00010000:1.0:1788839354.754146:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839355.774814:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839356.289604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839356.289724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729273344 00000100:00100000:1.0:1788839356.289737:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729273344 00000100:00100000:1.0:1788839356.289830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:1.0:1788839356.289846:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:10229:x1875733729273344:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839356.289875:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839356.289910:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6363feed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf3e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.290034:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363fef4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.290092:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363fef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.290110:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363fef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839356.290177:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788839356.290182:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839356.290231:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363fef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.290262:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6363feed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf3e expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.290285:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363fef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf3e expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.290319:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:1.0:1788839356.290323:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839356.290327:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c600, rc 0) 00000100:00080000:3.0:1788839356.290495:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839356.290544:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:10229:x1875733729273344:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 703us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839356.290553:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:0.0:1788839356.314203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839356.314415:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729273472 00000100:00100000:1.0:1788839356.314429:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729273472 00000100:00100000:0.0:1788839356.314695:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:0.0:1788839356.314709:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:10230:x1875733729273472:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839356.314736:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839356.314763:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fefb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf45 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.314845:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.314862:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.314877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.314892:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.314900:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.314920:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315717:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363ff10 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315736:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363ff10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315746:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363ff10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839356.315785:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839356.315791:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839356.315818:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363ff10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315831:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315838:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315845:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315852:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839356.315858:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315865:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315882:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:0.0:1788839356.315894:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839356.315901:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315909:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6363ff02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315930:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315936:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315943:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315949:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839356.315952:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315958:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315967:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91eb08280f00) 00010000:00010000:0.0:1788839356.315970:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839356.315972:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.315978:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.319391:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363fefb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf45 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.319462:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363ff10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf45 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.319473:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eb08280c00) 00010000:00010000:0.0:1788839356.319477:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839356.319481:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7600, rc 0) 00000100:00100000:0.0:1788839356.319595:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:10230:x1875733729273472:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 4887us (5408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839356.319605:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:2.0:1788839356.323879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839356.324322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729273728 00000100:00100000:1.0:1788839356.324336:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729273728 00000100:00100000:1.0:1788839356.324421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:1.0:1788839356.324438:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:10230:x1875733729273728:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839356.324465:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839356.324493:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6363ff17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf4c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.324618:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.324636:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839356.324648:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.331687:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.331722:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.331735:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332250:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332267:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332273:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839356.332285:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788839356.332467:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332480:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332486:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332490:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9cc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839356.332494:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332500:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332514:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eb08280c00) 00010000:00010000:0.0:1788839356.332516:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839356.332521:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332527:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6363ff1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332544:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332550:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332556:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332629:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839356.332638:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332645:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332654:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91eb08280f00) 00010000:00010000:0.0:1788839356.332656:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839356.332659:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.332665:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6363ff25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.336561:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6363ff17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf4c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.336628:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf4c expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839356.336642:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:0.0:1788839356.336646:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839356.336651:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6400, rc 0) 00000100:00100000:0.0:1788839356.336772:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:10230:x1875733729273728:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 12335us (12905us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788839356.336783:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:2.0:1788839356.342708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839356.343097:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729273856 00000100:00100000:1.0:1788839356.343113:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729273856 00000100:00100000:2.0:1788839356.343295:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:2.0:1788839356.343309:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:10230:x1875733729273856:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788839356.343466:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:10230:x1875733729273856:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 Request processed in 159us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839356.343474:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000040:00080000:2.0:1788839356.542111:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788839356.797336:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839357.506159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839357.507588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839357.507625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839357.507666:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729274240 00000100:00100000:2.0:1788839357.507685:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729273984 00000100:00100000:0.0:1788839357.507695:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729274240 00000100:00100000:2.0:1788839357.507701:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729273984 00000100:00100000:0.0:1788839357.507788:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729274112 00000100:00100000:0.0:1788839357.507795:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729274112 00000100:00100000:2.0:1788839357.507809:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 288 00000100:00100000:2.0:1788839357.507824:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729273984:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839357.507835:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 136 00000100:00100000:0.0:1788839357.507849:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729274240:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839357.507938:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729273984:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 118us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839357.507947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 288 00000100:00080000:1.0:1788839357.509363:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839357.509395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 137 00000100:00100000:1.0:1788839357.509411:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2356:x1875733729274112:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839357.510551:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729274240:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 2698us (2964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839357.510564:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 136 00000100:00100000:1.0:1788839357.524361:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2356:x1875733729274112:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 14942us (16721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839357.524376:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 137 00000100:00100000:1.0:1788839357.761625:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747137408:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.761704:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839357.761752:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747137920:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.761780:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839357.761807:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839357.761813:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747137792:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.761839:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839357.761868:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747137536:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.761893:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839357.761911:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747138048:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.761932:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839357.761970:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839357.761976:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747137664:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.761999:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839357.762033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137408 00000100:00100000:1.0:1788839357.762041:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137408 00000100:00100000:1.0:1788839357.762108:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788839357.762117:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747137408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.762169:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747137408:12345-0@lo:400:kworker.0 Request processed in 53us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839357.762191:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788839357.762225:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137920 00000100:00100000:1.0:1788839357.762229:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137920 00000100:00100000:1.0:1788839357.762262:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137536 00000100:00100000:1.0:1788839357.762265:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137536 00000100:00100000:1.0:1788839357.762277:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137664 00000100:00100000:1.0:1788839357.762279:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137664 00000100:00100000:1.0:1788839357.762294:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788839357.762300:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747137920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.762333:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747137920:12345-0@lo:400:kworker.0 Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839357.762339:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788839357.762352:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788839357.762357:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747137536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.762389:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747137536:12345-0@lo:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839357.762395:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788839357.762406:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788839357.762412:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747137664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.762439:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747137664:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839357.762444:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788839357.762460:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747137792 00000100:00100000:1.0:1788839357.762463:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747137792 00000100:00100000:1.0:1788839357.762486:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747138048 00000100:00100000:1.0:1788839357.762489:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747138048 00000100:00100000:1.0:1788839357.762507:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839357.762519:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747137792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.762548:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747137792:12345-0@lo:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839357.762554:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839357.762565:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839357.762571:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747138048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.762594:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747138048:12345-0@lo:400:kworker.0 Request processed in 23us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839357.762599:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788839357.762627:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839357.762631:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839357.762633:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839357.763651:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747137664:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.763665:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747137536:0@lo:400:kworker.0 00010000:00080000:1.0:1788839357.763677:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb3cbef100 x1875733747138048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839357.763688:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747138048:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.763726:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747137792:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.763735:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747137408:0@lo:400:kworker.0 00000100:00100000:1.0:1788839357.763745:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747137920:0@lo:400:kworker.0 00000001:00080000:0.0:1788839357.814821:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1788839357.821395:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839358.269365:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839358.269389:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747138176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839358.269466:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839358.269635:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747138176 00000100:00100000:1.0:1788839358.269643:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747138176 00000100:00100000:1.0:1788839358.269699:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788839358.269710:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747138176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839358.269753:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839358.269802:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747138176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839358.269809:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788839358.269912:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb33129f80 x1875733747138176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839358.269931:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747138176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839358.467174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839358.467985:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729274368 00000100:00100000:0.0:1788839358.468151:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729274368 00000100:00080000:1.0:1788839358.469974:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839358.470453:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:0.0:1788839358.470484:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:10273:x1875733729274368:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839358.470508:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839358.470543:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf53 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470608:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470638:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470652:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470668:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470676:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470682:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470881:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470889:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470896:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470901:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839358.470905:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470913:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470926:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:0.0:1788839358.470952:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839358.470959:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470965:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ff41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470978:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470985:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470991:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.470996:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839358.470999:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.471005:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.471022:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91eb08280f00) 00010000:00010000:0.0:1788839358.471026:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839358.471029:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.471035:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.471088:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf53 expref: 9 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.471111:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:0.0:1788839358.471113:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839358.471118:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf53 expref: 9 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.471128:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6200, rc 0) 00000100:00100000:0.0:1788839358.471198:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:10273:x1875733729274368:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 729us (4032us total) trans 0 rc 301/301 00000100:00100000:0.0:1788839358.482715:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:2.0:1788839358.492452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839358.493007:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729274624 00000100:00100000:0.0:1788839358.493019:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729274624 00000100:00100000:0.0:1788839358.493139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:0.0:1788839358.493152:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:10273:x1875733729274624:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:0.0:1788839358.493213:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839358.493239:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363fef4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf3e expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.493258:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:0.0:1788839358.493271:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839358.493981:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.493997:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.494009:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.494034:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.494111:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.494118:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839358.497746:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788839358.497768:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.497779:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.497788:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.497863:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839358.497869:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.497878:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.497895:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:0.0:1788839358.497898:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839358.497902:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.497923:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ff4f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839358.497954:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065167155 reply state 00000000aa5b0d2a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839358.497964:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839358.498377:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:10273:x1875733729274624:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 5223us (5949us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788839358.498395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00010000:00010000:1.0:1788839358.506575:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.506594:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.506602:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.506608:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839358.506614:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.506622:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.506640:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91eb08280900) 00010000:00010000:1.0:1788839358.506643:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839358.506648:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.506654:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6363ff56 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839358.687739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.687834:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729274752 00000100:00100000:1.0:1788839358.687844:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729274752 00000100:00100000:1.0:1788839358.687912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1788839358.687922:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+8:10281:x1875733729274752:12345-192.168.201.9@tcp:101:lctl.0 00010000:00010000:1.0:1788839358.687962:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839358.687985:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6363ff5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf5a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.688091:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d6363ff64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.688105:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d6363ff64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.688117:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d6363ff64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839358.688163:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788839358.688167:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839358.688207:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d6363ff64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.688238:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6363ff5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf5a expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.688256:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d6363ff64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf5a expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.688266:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:1.0:1788839358.688269:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839358.688273:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9dc00, rc 0) 00000100:00100000:1.0:1788839358.688328:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+9:10281:x1875733729274752:12345-192.168.201.9@tcp:101:lctl.0 Request processed in 406us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839358.688340:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:2.0:1788839358.743179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.743357:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729274880 00000100:00100000:1.0:1788839358.743368:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729274880 00000100:00100000:1.0:1788839358.743601:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1788839358.743611:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:10287:x1875733729274880:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839358.743629:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839358.743648:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6363ff6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf61 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743705:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743716:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743724:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743734:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743739:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743743:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743850:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d6363ff80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743874:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d6363ff80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743879:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d6363ff80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839358.743901:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788839358.743905:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839358.743964:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d6363ff80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743977:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743984:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743991:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.743998:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ca00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839358.744002:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744010:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744022:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:1.0:1788839358.744025:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839358.744030:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744046:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d6363ff72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744103:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744110:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744116:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744121:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839358.744125:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744130:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744136:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91eb05a79000) 00010000:00010000:1.0:1788839358.744138:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839358.744140:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744224:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d6363ff79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744252:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6363ff6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf61 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744261:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d6363ff80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf61 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.744271:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839358.744272:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788839358.744274:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c800, rc 0) 00000100:00100000:1.0:1788839358.744356:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+10:10287:x1875733729274880:12345-192.168.201.9@tcp:101:bash.0 Request processed in 747us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839358.744361:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:0.0:1788839358.748458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.748686:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729275136 00000100:00100000:1.0:1788839358.748697:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729275136 00000100:00100000:1.0:1788839358.748745:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:1.0:1788839358.748753:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+10:10287:x1875733729275136:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839358.748770:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839358.748799:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363ff87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf68 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.748912:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.748933:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.748950:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.748967:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.748985:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749012:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788839358.749588:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788839358.749717:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749725:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749730:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749754:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749759:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749763:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749767:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839358.749770:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749775:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749783:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839358.749785:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839358.749796:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749803:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6363ff8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839358.749816:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bde9281 reply state 000000009cfb9c49 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839358.749824:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788839358.749854:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6363ff87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749868:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.749874:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:1.0:1788839358.749877:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839358.749879:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9da00, rc 0) 00000100:00100000:1.0:1788839358.749954:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10287:x1875733729275136:12345-192.168.201.9@tcp:101:bash.0 Request processed in 1200us (1503us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788839358.749962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00010000:00010000:1.0:1788839358.753108:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.753126:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.753132:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.753678:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839358.753682:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.753688:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.753703:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb05a79d00) 00010000:00010000:1.0:1788839358.753705:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839358.753708:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.753712:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6363ff95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839358.753875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.754138:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729275264 00000100:00100000:1.0:1788839358.754350:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729275264 00000100:00100000:1.0:1788839358.754469:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:1.0:1788839358.754477:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875733729275264:12345-192.168.201.9@tcp:8:bash.0 00010000:00080000:1.0:1788839358.754508:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:1.0:1788839358.754540:0:6697:0:(genops.c:1385:class_connect()) connect: client 07d32060-78a7-4509-9f5d-feb437ccdae6, cookie 0x4b63896d6363ffaa 00002000:00100000:1.0:1788839358.754551:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07d32060-78a7-4509-9f5d-feb437ccdae6/ffff91eb033e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788839358.754563:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788839358.754804:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788839358.754833:0:6697:0:(import.c:65:import_set_state_nolock()) ffff91eb033ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839358.755002:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2354:x1875733729275264:12345-192.168.201.9@tcp:8:bash.0 Request processed in 523us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839358.755022:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:2.0:1788839358.760206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.760988:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729275392 00000100:00100000:1.0:1788839358.760999:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729275392 00000100:00080000:2.0:1788839358.761233:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839358.761245:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:1.0:1788839358.761256:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:0:x1875733729275392:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839358.761277:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839358.761301:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf6f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839358.761330:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788839358.761348:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1788839358.761353:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839358.761363:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.761396:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.761410:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c600, rc 0) 00000100:00100000:1.0:1788839358.761503:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:0:x1875733729275392:12345-192.168.201.9@tcp:101:bash.0 Request processed in 249us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839358.761511:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:3.0:1788839358.766181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839358.766254:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729275520 00000100:00100000:2.0:1788839358.766262:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729275520 00000100:00100000:2.0:1788839358.766312:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:2.0:1788839358.766322:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:10287:x1875733729275520:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839358.766340:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839358.766357:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf76 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.766450:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.766459:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839358.766464:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839358.766469:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.766503:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.766518:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 8 pid: 6696 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839358.766594:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747138304:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839358.766702:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788839358.769158:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747138304:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839358.769196:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.769216:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebaa00, rc 0) 00000100:00100000:2.0:1788839358.769306:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:10287:x1875733729275520:12345-192.168.201.9@tcp:101:bash.0 Request processed in 2984us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839358.769315:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:3.0:1788839358.769658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839358.769744:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729275648 00000100:00100000:0.0:1788839358.769751:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729275648 00010000:00010000:0.0:1788839358.769784:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 8 pid: 6696 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839358.770454:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:0.0:1788839358.770480:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729275648:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839358.770502:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839358.770527:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 8 pid: 6696 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.770541:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 8 pid: 6696 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.770587:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000be2b935/0x4b63896d6363ffb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf6f expref: 8 pid: 6696 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.770602:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839358.770605:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839358.770614:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.770623:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.770657:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839358.770670:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1875733747138432:192.168.201.9@tcp:105: 00000100:00100000:0.0:1788839358.770749:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839358.773722:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1875733747138432:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839358.773747:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839358.773841:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729275648:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 3364us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839358.773852:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:1.0:1788839358.775758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839358.775834:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729275904 00000100:00100000:3.0:1788839358.775844:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729275904 00000100:00100000:3.0:1788839358.775920:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1788839358.775933:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+12:10287:x1875733729275904:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:3.0:1788839358.776483:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10287:x1875733729275904:12345-192.168.201.9@tcp:35:bash.0 Request processed in 548us (730us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788839358.776493:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1788839358.781245:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839358.781270:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747138560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839358.781348:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839358.781613:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747138560 00000100:00100000:0.0:1788839358.781621:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747138560 00000100:00100000:0.0:1788839358.781709:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788839358.781719:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747138560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839358.781772:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839358.781832:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747138560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839358.781839:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788839358.781931:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747138560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839358.841613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839358.841853:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729276160 00000100:00100000:0.0:1788839358.841864:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729276160 00000100:00100000:0.0:1788839358.841932:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:0.0:1788839358.841964:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10297:x1875733729276160:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839358.841989:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839358.842014:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6363ffbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf7d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839358.842146:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788839358.842255:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6363ffbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf7d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.842270:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:0.0:1788839358.842273:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839358.842278:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6363ffbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf7d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.842291:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839358.842337:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+14:10297:x1875733729276160:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 397us (734us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788839358.842344:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00010000:00010000:1.0:1788839358.845230:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839358.849291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839358.849461:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729276416 00000100:00100000:0.0:1788839358.849471:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729276416 00000100:00100000:0.0:1788839358.849615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:0.0:1788839358.849624:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+14:10297:x1875733729276416:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1788839358.849919:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+15:10297:x1875733729276416:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 295us (635us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788839358.849926:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1788839358.943467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.944653:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729276544 00000100:00100000:1.0:1788839358.944664:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729276544 00000100:00100000:0.0:1788839358.944847:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:0.0:1788839358.944860:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+15:10303:x1875733729276544:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839358.944884:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839358.944915:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6363ffcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf84 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.945403:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ffd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.945419:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.945431:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839358.945464:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788839358.945468:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839358.945485:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.945511:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6363ffcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf84 expref: 17 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.945634:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ffd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf84 expref: 16 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.945660:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839358.945663:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839358.945667:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7e00, rc 0) 00000100:00100000:0.0:1788839358.945741:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+16:10303:x1875733729276544:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 883us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839358.945748:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:1.0:1788839358.953267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839358.953358:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729276800 00000100:00100000:0.0:1788839358.953369:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729276800 00000100:00100000:0.0:1788839358.953438:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:0.0:1788839358.953450:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+16:10303:x1875733729276800:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839358.953473:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839358.953495:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6363ffdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.953613:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ffe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.953628:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ffe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.953639:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ffe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839358.953650:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788839358.953775:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6363ffdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf8b expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.953816:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ffe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf8b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839358.953825:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:0.0:1788839358.953828:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839358.953832:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6200, rc 0) 00000100:00100000:0.0:1788839358.953895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+18:10303:x1875733729276800:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 447us (638us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788839358.953903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:2.0:1788839358.958741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.958834:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729277056 00000100:00100000:1.0:1788839358.958843:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729277056 00000100:00100000:1.0:1788839358.958904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:1.0:1788839358.958916:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:10303:x1875733729277056:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839358.958958:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839358.958985:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d6363fff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf92 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.959121:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fff7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.959136:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.959148:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839358.959160:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788839358.959294:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d6363fff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf92 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.959314:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf92 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.959324:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:1.0:1788839358.959341:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788839358.959346:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d600, rc 0) 00000100:00100000:1.0:1788839358.959648:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+20:10303:x1875733729277056:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 734us (917us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788839358.959655:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:2.0:1788839358.962750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839358.968911:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729277184 00000100:00100000:3.0:1788839358.968943:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729277184 00000100:00100000:2.0:1788839358.969177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839358.969222:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729277312 00000100:00100000:2.0:1788839358.969226:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729277312 00000100:00100000:2.0:1788839358.969265:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:2.0:1788839358.969276:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729277312:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:2.0:1788839358.969318:0:9213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.969339:0:9213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.969367:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839358.969383:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839358.969388:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.969422:0:9213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839358.969436:0:9213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 7 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839358.969451:0:9213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9213:1875733747138688:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839358.969549:0:9213:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839358.971601:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:3.0:1788839358.971617:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+20:2355:x1875733729277184:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839358.971636:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839358.971663:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6363ffe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf8b expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839358.971682:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:3.0:1788839358.971687:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839358.971750:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:2355:x1875733729277184:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 138us (9010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839358.971758:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:2.0:1788839358.972269:0:9213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9213:1875733747138688:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839358.972295:0:9213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839358.975843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839358.975928:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729277440 00000100:00100000:1.0:1788839358.975966:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729277440 00002000:00100000:1.0:1788839358.976028:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91eb0310ad80 x1875733729277440/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:504/0 lens 504/0 e 0 to 0 dl 1788839369 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839358.976040:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb0310ad80 with x1875733729277440 ext(0->12) 00010000:00010000:1.0:1788839358.976093:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 8 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839358.976112:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 8 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839358.976120:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb0310ad80 00000100:00100000:1.0:1788839358.976143:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:1.0:1788839358.976153:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729277440:12345-192.168.201.9@tcp:4:lfs.0 00000001:00100000:3.0:1788839359.006621:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000100:00100000:1.0:1788839359.007485:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2357:x1875733729277440:12345-192.168.201.9@tcp:4:lfs.0 Request processed in 31327us (31646us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788839359.007497:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00002000:00100000:1.0:1788839359.007509:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91eb0310ad80 x1875733729277440/t4294967299(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:504/0 lens 504/448 e 0 to 0 dl 1788839369 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839359.007528:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb0310ad80 with x1875733729277440 ext(0->12) 00010000:00010000:1.0:1788839359.007547:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.007565:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839359.007573:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb0310ad80 00000100:00100000:2.0:1788839359.010516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839359.010684:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729277568 00000100:00100000:1.0:1788839359.010694:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729277568 00010000:00010000:1.0:1788839359.010736:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839359.010814:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:1.0:1788839359.010824:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729277568:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839359.010840:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788839359.010859:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788839359.010862:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788839359 00002000:00010000:1.0:1788839359.010865:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788839359 00002000:00010000:1.0:1788839359.010867:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788839359 00010000:00010000:1.0:1788839359.010873:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.010888:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.010912:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7785096/0x4b63896d6363ffb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf76 expref: 9 pid: 6698 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.010966:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839359.010971:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839359.010977:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.010987:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.011019:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839359.011119:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729277568:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 296us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839359.011127:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00010000:00010000:2.0:1788839359.011197:0:9213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011206:0:9213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011243:0:9213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011252:0:9213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011259:0:9213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011266:0:9213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebae00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839359.011270:0:9213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011279:0:9213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011294:0:9213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.011300:0:9213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839359.011363:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729277312:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 42088us (42190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839359.011379:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:2.0:1788839359.014692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839359.014767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729277824 00000100:00100000:3.0:1788839359.014777:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729277824 00000100:00100000:3.0:1788839359.014848:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1788839359.014858:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:10303:x1875733729277824:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:3.0:1788839359.014923:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf92 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839359.016259:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788839359.016400:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788839359.016917:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788839359.016992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839359.017011:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839359.017021:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839359.017094:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839359.017111:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 23 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839359.017126:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbe2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875733747138816:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839359.017769:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36f88900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839359.020778:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbe2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875733747138816:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839359.020809:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839359.021102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.021423:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729277952 00000100:00100000:0.0:1788839359.021431:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729277952 00010000:00010000:0.0:1788839359.021468:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 24 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839359.021506:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:0.0:1788839359.021516:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+24:2357:x1875733729277952:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839359.021541:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839359.021548:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 24 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.021561:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 24 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.021598:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6363ff9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf68 expref: 24 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.021614:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:0.0:1788839359.021619:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.021629:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.021637:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.021665:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839359.021762:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+23:2357:x1875733729277952:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 247us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839359.021771:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00010000:00010000:2.0:1788839359.023305:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.023320:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839359.023467:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788839359.023677:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788839359.023810:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3caf2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747138944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839359.023878:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839359.023907:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839359.024206:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747138944 00000100:00100000:1.0:1788839359.024214:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747138944 00000100:00100000:1.0:1788839359.024274:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839359.024285:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747138944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788839359.024371:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747138944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839359.024378:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788839359.025184:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839359.025226:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3caf2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747138944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839359.026505:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788839359.027294:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3caf2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747139072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839359.027473:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839359.027756:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839359.033551:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747139072 00000100:00100000:1.0:1788839359.033568:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747139072 00000100:00100000:0.0:1788839359.042034:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839359.042091:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747139072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788839359.042594:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875733747139072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 546us (15120us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788839359.042602:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839359.042756:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3caf2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747139072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839359.042833:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788839359.042886:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.042898:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.042906:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.042929:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839359.042945:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.042954:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.042972:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:2.0:1788839359.042975:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788839359.042981:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839359.042987:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364000c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839359.043236:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788839359.043476:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788839359.043488:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341734437717ns, next at 342734435822ns, rc = 0 00000001:00080000:2.0:1788839359.043496:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788839359.043537:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb05a79300) 00010000:00010000:2.0:1788839359.043541:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839359.043548:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d6363fff7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf92 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839359.043649:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+26:10303:x1875733729277824:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 28792us (28966us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788839359.043657:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000020:00080000:2.0:1788839359.043660:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788839359.048636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.048786:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729278080 00000100:00100000:0.0:1788839359.048795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729278080 00000100:00100000:0.0:1788839359.048852:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:0.0:1788839359.048862:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+26:10303:x1875733729278080:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839359.048885:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839359.048923:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaf99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.048995:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640013 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf99 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.049009:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640013 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf99 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.049029:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839359.049033:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839359.049037:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839359.049117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+27:10303:x1875733729278080:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 255us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839359.049126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:0.0:1788839359.053784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839359.053873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729278336 00000100:00100000:3.0:1788839359.053884:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729278336 00000100:00100000:3.0:1788839359.053954:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:3.0:1788839359.053966:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+27:10303:x1875733729278336:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1788839359.054281:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+28:10303:x1875733729278336:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 317us (510us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788839359.054290:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1788839359.186403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.186625:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729278592 00000100:00100000:0.0:1788839359.186635:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729278592 00000100:00100000:0.0:1788839359.186701:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:0.0:1788839359.186711:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+28:10313:x1875733729278592:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839359.186736:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839359.186757:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364001a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafa0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839359.186849:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788839359.187021:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364001a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa0 expref: 30 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.187097:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:0.0:1788839359.187101:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839359.187108:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364001a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa0 expref: 30 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.187122:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839359.187181:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10313:x1875733729278592:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 471us (787us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788839359.187188:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:2.0:1788839359.192532:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.192636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729278720 00000100:00100000:0.0:1788839359.192646:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729278720 00000100:00100000:0.0:1788839359.192709:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:0.0:1788839359.192720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10313:x1875733729278720:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:0.0:1788839359.192814:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.192833:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.192847:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.192865:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.192872:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.192898:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193000:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193009:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193016:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839359.193093:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193106:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193113:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193119:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193125:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839359.193130:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193138:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193150:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839359.193159:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839359.193165:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193172:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193185:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193191:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193197:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193203:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839359.193206:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193212:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193219:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280f00) 00010000:00010000:0.0:1788839359.193222:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839359.193225:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193390:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364002f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193406:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193428:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193435:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193439:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839359.193442:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193513:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193524:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839359.193526:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839359.193530:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.193535:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839359.193665:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10313:x1875733729278720:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 946us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839359.193672:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:2.0:1788839359.197104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.197208:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729278976 00000100:00100000:0.0:1788839359.197218:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729278976 00000100:00100000:0.0:1788839359.197467:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1788839359.197479:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10313:x1875733729278976:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1788839359.197766:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+30:10313:x1875733729278976:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 288us (715us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788839359.197780:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1788839359.264319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.264649:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729279232 00000100:00100000:0.0:1788839359.264660:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729279232 00000100:00100000:0.0:1788839359.264723:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:0.0:1788839359.264734:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+30:10316:x1875733729279232:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839359.264758:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839359.264781:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364003d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafa7 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.264860:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.264877:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.264889:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.264906:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.264912:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.264938:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265256:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265294:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265301:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839359.265312:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788839359.265410:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265602:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265609:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265614:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839359.265619:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265626:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265639:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839359.265642:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839359.265646:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265652:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265666:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265678:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265683:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265686:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839359.265688:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265693:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265700:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280f00) 00010000:00010000:0.0:1788839359.265702:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839359.265706:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265711:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364004b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265753:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364003d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 33 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265767:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 32 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.265774:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839359.265777:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839359.265784:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839359.265889:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+32:10316:x1875733729279232:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1157us (1581us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788839359.265897:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:2.0:1788839359.275586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.275691:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729279360 00000100:00100000:0.0:1788839359.275702:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729279360 00000100:00100000:0.0:1788839359.275763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:0.0:1788839359.275773:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:10316:x1875733729279360:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1788839359.275849:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275866:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275876:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275903:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275910:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275929:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275944:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839359.275948:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275956:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275983:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839359.275986:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839359.275992:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.275998:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839359.276123:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:10316:x1875733729279360:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 350us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839359.276132:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:2.0:1788839359.280771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839359.280954:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729279616 00000100:00100000:3.0:1788839359.280965:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729279616 00000100:00100000:3.0:1788839359.281026:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1788839359.281037:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:10316:x1875733729279616:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1788839359.281304:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+33:10316:x1875733729279616:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 268us (543us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788839359.281311:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1788839359.703381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839359.703759:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729279872 00000100:00100000:1.0:1788839359.703770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729279872 00000100:00100000:1.0:1788839359.703834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:1.0:1788839359.703844:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+33:10347:x1875733729279872:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:1.0:1788839359.703869:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839359.703919:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640067 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.704028:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364006e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.704043:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364006e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.704086:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364006e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839359.704098:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788839359.704252:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640067 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafae expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.704272:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364006e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafae expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.704281:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839359.704284:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839359.704288:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d400, rc 0) 00000100:00100000:1.0:1788839359.704607:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+35:10347:x1875733729279872:12345-192.168.201.9@tcp:101:cat.0 Request processed in 762us (1373us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788839359.704616:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1788839359.726704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839359.726809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839359.727171:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729280256 00000100:00100000:3.0:1788839359.727181:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729280256 00000100:00100000:0.0:1788839359.727187:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729280000 00000100:00100000:0.0:1788839359.727191:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729280000 00000100:00100000:0.0:1788839359.727247:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:0.0:1788839359.727257:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+36:2358:x1875733729280000:12345-192.168.201.9@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788839359.727274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00010000:00010000:0.0:1788839359.727274:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788839359.727283:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+36:10347:x1875733729280256:12345-192.168.201.9@tcp:35:cat.0 00010000:00010000:0.0:1788839359.727300:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364006e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafae expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.727319:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839359.727324:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839359.727377:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+35:2358:x1875733729280000:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 122us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839359.727384:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:3.0:1788839359.727501:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:10347:x1875733729280256:12345-192.168.201.9@tcp:35:cat.0 Request processed in 219us (1602us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788839359.727623:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1788839359.842146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839359.842351:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729280512 00000100:00100000:0.0:1788839359.842362:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729280512 00000100:00100000:0.0:1788839359.842427:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:0.0:1788839359.842454:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:10353:x1875733729280512:12345-192.168.201.9@tcp:101:dd.0 00010000:00010000:0.0:1788839359.842494:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839359.842498:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788839359.842526:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6363ffd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf84 expref: 35 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.842546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839359.842551:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839359.842566:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364007c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafb5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.842665:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.842679:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 35 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.842687:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.842722:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 35 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.842736:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 35 pid: 8483 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839359.842750:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747139200:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839359.842860:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839359.846240:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747139200:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839359.846271:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839359.848033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839359.851151:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729280640 00000100:00100000:1.0:1788839359.851183:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729280640 00010000:00010000:1.0:1788839359.851236:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 36 pid: 8483 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839359.851289:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1788839359.851302:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+36:2357:x1875733729280640:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839359.851321:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839359.851329:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 36 pid: 8483 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.851343:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 36 pid: 8483 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.851704:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafa7 expref: 36 pid: 8483 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.851725:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839359.851730:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.851739:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.851748:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.851787:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839359.851867:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:2357:x1875733729280640:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 568us (3841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839359.852827:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00010000:00010000:0.0:1788839359.853212:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.853223:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839359.853244:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788839359.853433:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364007c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.853659:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839359.853669:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839359.853672:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839359.853675:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839359.853795:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:10353:x1875733729280512:12345-192.168.201.9@tcp:101:dd.0 Request processed in 11344us (11660us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788839359.853803:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1788839359.862940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839359.863094:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729280896 00000100:00100000:1.0:1788839359.863106:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729280896 00000100:00100000:1.0:1788839359.863160:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:1.0:1788839359.863171:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+35:10353:x1875733729280896:12345-192.168.201.9@tcp:36:dd.0 00010000:00010000:1.0:1788839359.863805:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.863826:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.863838:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839359.863898:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788839359.863936:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d0f7436 reply state 00000000890a1b12 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839359.863946:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839359.864796:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+38:10353:x1875733729280896:12345-192.168.201.9@tcp:36:dd.0 Request processed in 879us (1132us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788839359.864807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000020:00080000:1.0:1788839359.864824:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788839359.869320:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839359.870669:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.870686:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.870693:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.870714:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839359.870719:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.870727:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.870744:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839359.870747:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839359.870751:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839359.870758:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640091 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839360.258991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839360.259089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729281024 00000100:00100000:1.0:1788839360.259100:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729281024 00000100:00100000:1.0:1788839360.259192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1788839360.259204:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+37:10367:x1875733729281024:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:1.0:1788839360.259230:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839360.259254:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafbc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259324:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259340:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259351:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259383:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259391:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259397:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259489:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259501:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259509:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259547:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.259559:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 38 pid: 5842 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839360.259573:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747139328:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839360.259677:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f0540 going to sleep for 11 seconds 00000100:00080000:2.0:1788839360.259957:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839360.274696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839360.276003:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729281280 00000100:00100000:2.0:1788839360.276019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729281280 00000100:00100000:2.0:1788839360.276144:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1788839360.276156:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+39:5594:x1875733729281280:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788839360.276559:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+40:5594:x1875733729281280:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 405us (1871us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788839360.276567:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:1.0:1788839360.276990:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747139328:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839360.277022:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839360.281399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839360.281535:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729281408 00000100:00100000:1.0:1788839360.281548:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729281408 00010000:00010000:1.0:1788839360.281607:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 40 pid: 5842 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839360.281660:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1788839360.281673:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+40:2357:x1875733729281408:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839360.281694:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839360.281701:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 40 pid: 5842 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.281716:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 40 pid: 5842 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.281747:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640083 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafb5 expref: 40 pid: 5842 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.281769:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839360.281777:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.281789:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.281799:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.281838:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839360.281936:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+39:2357:x1875733729281408:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 265us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839360.281944:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00010000:00010000:2.0:1788839360.282037:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282092:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839360.282151:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788839360.282157:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839360.282246:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282263:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282285:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282292:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282300:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282305:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9cc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839360.282309:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282317:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282332:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839360.282336:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839360.282340:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282347:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d6364009f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282366:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282373:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282619:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282625:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839360.282631:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282637:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282647:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb42074400) 00010000:00010000:2.0:1788839360.282649:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839360.282652:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282657:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d636400a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282708:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafbc expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282725:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafbc expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.282733:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:2.0:1788839360.282735:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839360.282738:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d600, rc 0) 00000100:00100000:2.0:1788839360.282861:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+38:10367:x1875733729281024:12345-192.168.201.9@tcp:101:stat.0 Request processed in 23660us (23877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839360.282879:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:3.0:1788839360.428292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.428379:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729281664 00000100:00100000:0.0:1788839360.428393:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729281664 00000100:00100000:0.0:1788839360.428481:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:0.0:1788839360.428494:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+38:10373:x1875733729281664:12345-192.168.201.9@tcp:36:truncate.0 00010000:00010000:0.0:1788839360.428754:0:8483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839360.428791:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636400ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafbc expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.428814:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839360.428838:0:8483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839360.429420:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.429442:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.429455:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839360.429519:0:8483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788839360.429557:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a95633c reply state 00000000b39b166d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839360.429568:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839360.429731:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+40:10373:x1875733729281664:12345-192.168.201.9@tcp:36:truncate.0 Request processed in 1237us (1449us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788839360.429741:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00000020:00080000:0.0:1788839360.429747:0:8483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788839360.437096:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.437123:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.437133:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.437139:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839360.437145:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.437153:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.437179:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839360.437182:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839360.437189:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.437195:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636400b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839360.618012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.618371:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729281792 00000100:00100000:0.0:1788839360.618395:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729281792 00000100:00100000:0.0:1788839360.618484:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:0.0:1788839360.618505:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+39:10387:x1875733729281792:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:0.0:1788839360.618547:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839360.618580:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafc3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618710:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618733:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618760:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618781:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618789:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618796:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618935:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.618942:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839360.618988:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788839360.618993:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839360.619021:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619034:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619042:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619267:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619274:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619281:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839360.619286:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619295:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619311:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839360.619315:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839360.619321:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619327:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636400c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619343:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619349:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619355:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619359:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839360.619368:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619632:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619641:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280f00) 00010000:00010000:0.0:1788839360.619643:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839360.619647:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619652:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636400c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619696:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619710:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.619718:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839360.619720:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839360.619723:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:0.0:1788839360.620582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+40:10387:x1875733729281792:12345-192.168.201.9@tcp:101:stat.0 Request processed in 2072us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839360.620595:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:1.0:1788839360.713301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839360.713452:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729282048 00000100:00100000:2.0:1788839360.713466:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729282048 00000100:00100000:2.0:1788839360.713608:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:2.0:1788839360.713621:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+40:10397:x1875733729282048:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839360.713648:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839360.713674:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636400d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafca expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839360.713798:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788839360.714261:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636400d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafca expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.714280:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:2.0:1788839360.714284:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839360.714290:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636400d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafca expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.714329:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba200, rc 0) 00000100:00100000:2.0:1788839360.714423:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+41:10397:x1875733729282048:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 805us (1138us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788839360.714432:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:2.0:1788839360.721924:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.722411:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729282304 00000100:00100000:0.0:1788839360.722424:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729282304 00000100:00100000:0.0:1788839360.722495:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1788839360.722506:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+41:10397:x1875733729282304:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1788839360.722830:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+42:10397:x1875733729282304:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 324us (938us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788839360.722838:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1788839360.772684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839360.772838:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729282560 00000100:00100000:1.0:1788839360.772852:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729282560 00000100:00100000:1.0:1788839360.772941:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:1.0:1788839360.772953:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+42:10403:x1875733729282560:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839360.773005:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839360.773033:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636400e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafd1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.773214:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.773230:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.773239:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.773281:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.773295:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 43 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839360.773311:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747139456:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839360.773433:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788839360.778807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839360.779106:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33129880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747139456:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839360.779151:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839360.779446:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729282688 00000100:00100000:3.0:1788839360.779456:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729282688 00010000:00010000:3.0:1788839360.779575:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 44 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839360.779711:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:3.0:1788839360.779722:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+44:2357:x1875733729282688:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839360.779743:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839360.779752:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 44 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839360.779765:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 44 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839360.779792:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636400d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafc3 expref: 44 pid: 5842 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839360.779813:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:3.0:1788839360.779819:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839360.779830:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839360.779840:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839360.780047:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839360.780183:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+43:2357:x1875733729282688:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 460us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839360.780192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00010000:00010000:2.0:1788839360.781831:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.781850:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839360.781879:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788839360.782347:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636400e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.782374:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.782383:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:2.0:1788839360.782386:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839360.782390:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c600, rc 0) 00000100:00100000:2.0:1788839360.782593:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+43:10403:x1875733729282560:12345-192.168.201.9@tcp:101:bash.0 Request processed in 9640us (9920us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788839360.782604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:3.0:1788839360.786373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.786525:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729282944 00000100:00100000:0.0:1788839360.786539:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729282944 00000100:00100000:0.0:1788839360.786624:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:0.0:1788839360.786638:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+43:10403:x1875733729282944:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:0.0:1788839360.787000:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.787021:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.787033:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839360.787116:0:8483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788839360.787140:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1c9fdbe reply state 00000000c78482ca transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839360.787150:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839360.787750:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+46:10403:x1875733729282944:12345-192.168.201.9@tcp:36:bash.0 Request processed in 1110us (1387us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788839360.787760:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000020:00080000:0.0:1788839360.787767:0:8483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788839360.792805:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.792830:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.792838:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.792862:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839360.792868:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.792877:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.792918:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839360.792922:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839360.792928:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.792935:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636400fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839360.794683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.794857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729283072 00000100:00100000:0.0:1788839360.794870:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729283072 00000100:00100000:0.0:1788839360.794967:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:0.0:1788839360.794979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+45:10403:x1875733729283072:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839360.795033:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839360.795095:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640101 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafd8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.795203:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.795220:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.795230:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.795275:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.795291:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 46 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839360.795308:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747139584:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839360.795419:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839360.800311:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747139584:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839360.800352:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839360.801836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839360.801954:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729283200 00000100:00100000:1.0:1788839360.801965:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729283200 00010000:00010000:1.0:1788839360.802015:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 47 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839360.802096:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:1.0:1788839360.802108:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+47:2358:x1875733729283200:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839360.802127:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839360.802135:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 47 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.802150:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 47 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.802189:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d636400ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd1 expref: 47 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.802209:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839360.802215:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.802226:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.802235:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.802264:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839360.802327:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+46:2358:x1875733729283200:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 220us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839360.802335:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00010000:00010000:2.0:1788839360.802400:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.802410:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839360.802467:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788839360.802477:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839360.802502:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.802537:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd8 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.802553:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd8 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.802562:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:2.0:1788839360.802564:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839360.802567:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:2.0:1788839360.802605:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+45:10403:x1875733729283072:12345-192.168.201.9@tcp:101:bash.0 Request processed in 7629us (7937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839360.802613:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:3.0:1788839360.806560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.806675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729283456 00000100:00100000:0.0:1788839360.806689:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729283456 00000100:00100000:0.0:1788839360.806759:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:0.0:1788839360.806789:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+45:10403:x1875733729283456:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:0.0:1788839360.807548:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+46:10403:x1875733729283456:12345-192.168.201.9@tcp:35:bash.0 Request processed in 757us (998us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788839360.807558:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:3.0:1788839360.889128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839360.889355:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729283712 00000100:00100000:2.0:1788839360.889368:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729283712 00000100:00100000:2.0:1788839360.889451:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:2.0:1788839360.889463:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+46:10413:x1875733729283712:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839360.889506:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839360.889536:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364010f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafdf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839360.889662:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788839360.889819:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364010f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafdf expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.889838:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:2.0:1788839360.889860:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839360.889870:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364010f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafdf expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.889928:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb800, rc 0) 00000100:00100000:2.0:1788839360.890011:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10413:x1875733729283712:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 549us (898us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788839360.890019:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00010000:00010000:1.0:1788839360.893290:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839360.897921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839360.898026:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729283840 00000100:00100000:1.0:1788839360.898040:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729283840 00000100:00100000:1.0:1788839360.898137:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:1.0:1788839360.898150:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10413:x1875733729283840:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:1.0:1788839360.898254:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898275:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898289:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898321:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898329:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898335:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898443:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898451:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898457:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839360.898524:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898538:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898543:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898550:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898556:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839360.898560:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898584:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898599:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839360.898602:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839360.898608:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898614:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364011d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898631:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898636:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898642:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898647:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839360.898649:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898655:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898661:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb42074100) 00010000:00010000:1.0:1788839360.898664:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839360.898666:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898681:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898697:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898704:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898709:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898714:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839360.898717:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898724:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898730:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839360.898732:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839360.898735:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.898741:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364012b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839360.898832:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10413:x1875733729283840:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 683us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839360.898840:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:3.0:1788839360.901177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.901293:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729284096 00000100:00100000:0.0:1788839360.901304:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729284096 00000100:00100000:0.0:1788839360.901368:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:0.0:1788839360.901380:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10413:x1875733729284096:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1788839360.901669:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+48:10413:x1875733729284096:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 290us (504us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788839360.901678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1788839360.933271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839360.933402:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729284352 00000100:00100000:2.0:1788839360.933416:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729284352 00000100:00100000:2.0:1788839360.933500:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:2.0:1788839360.933512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+48:10416:x1875733729284352:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839360.933544:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839360.933572:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640132 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafe6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.933847:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.933864:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.933877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.933893:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.933900:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.933938:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934123:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934132:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934140:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839360.934151:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788839360.934265:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934274:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934282:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934288:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839360.934293:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934301:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934314:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839360.934317:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839360.934329:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934335:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640139 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934368:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934374:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934381:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934386:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839360.934388:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934394:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934400:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb03866a00) 00010000:00010000:2.0:1788839360.934402:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839360.934404:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934410:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934455:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafe6 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934771:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafe6 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839360.934783:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:2.0:1788839360.934786:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839360.934789:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba200, rc 0) 00000100:00100000:2.0:1788839360.934939:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10416:x1875733729284352:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1428us (1682us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788839360.934949:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:2.0:1788839360.939673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839360.939842:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729284480 00000100:00100000:1.0:1788839360.939859:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729284480 00000100:00100000:1.0:1788839360.939960:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:1.0:1788839360.939974:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10416:x1875733729284480:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:1.0:1788839360.940126:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940152:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940168:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940207:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940214:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940222:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940228:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839360.940233:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940242:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940257:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:1.0:1788839360.940261:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839360.940267:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839360.940301:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839360.940411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10416:x1875733729284480:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 439us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839360.940420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:3.0:1788839360.943478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839360.943589:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729284736 00000100:00100000:2.0:1788839360.943603:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729284736 00000100:00100000:2.0:1788839360.943680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:2.0:1788839360.943692:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10416:x1875733729284736:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839360.944027:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+51:10416:x1875733729284736:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 335us (565us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788839360.944036:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:3.0:1788839360.947881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839360.960081:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729284864 00000100:00100000:0.0:1788839360.960103:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729284864 00000100:00100000:0.0:1788839360.960206:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1788839360.960218:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+51:2356:x1875733729284864:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839360.960240:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839360.960273:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafe6 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839360.960321:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839360.960327:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839360.960418:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+50:2356:x1875733729284864:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 201us (12552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839360.960426:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:3.0:1788839361.069043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839361.069246:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729285120 00000100:00100000:0.0:1788839361.069277:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729285120 00000100:00100000:0.0:1788839361.069358:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:0.0:1788839361.069371:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10433:x1875733729285120:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:0.0:1788839361.069402:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839361.069430:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364015c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbafed expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.069569:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640163 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.069585:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.069600:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839361.069612:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788839361.069779:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364015c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafed expref: 53 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.069802:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafed expref: 52 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.069812:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839361.069815:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788839361.069819:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839361.069916:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10433:x1875733729285120:12345-192.168.201.9@tcp:101:cat.0 Request processed in 548us (887us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788839361.069925:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:2.0:1788839361.095867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839361.096250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729285248 00000100:00100000:1.0:1788839361.096266:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729285248 00000100:00100000:1.0:1788839361.096393:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:1.0:1788839361.096407:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10435:x1875733729285248:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839361.096442:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839361.096474:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaff4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.096584:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640178 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.096602:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.096616:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839361.096661:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788839361.096665:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839361.096688:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.096723:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaff4 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.096766:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaff4 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.096776:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839361.096779:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839361.096783:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c200, rc 0) 00000100:00100000:1.0:1788839361.096868:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10435:x1875733729285248:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 465us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839361.096877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:3.0:1788839361.101128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839361.101602:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729285632 00000100:00100000:2.0:1788839361.101617:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729285632 00000100:00100000:2.0:1788839361.101705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:2.0:1788839361.101718:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10435:x1875733729285632:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839361.102218:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10435:x1875733729285632:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 498us (1098us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788839361.102248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1788839361.106971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839361.107123:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729285760 00000100:00100000:0.0:1788839361.107139:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729285760 00000100:00100000:0.0:1788839361.107244:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:0.0:1788839361.107259:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10435:x1875733729285760:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:0.0:1788839361.107288:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788839361.107334:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafd8 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.107364:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbafed expref: 53 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.107379:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf99 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.107390:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839361.107402:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839361.107475:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+51:10435:x1875733729285760:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 219us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.107493:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:2.0:1788839361.109515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839361.109599:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729285888 00000100:00100000:0.0:1788839361.109611:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729285888 00000100:00100000:0.0:1788839361.109687:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:0.0:1788839361.109701:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+51:10435:x1875733729285888:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:0.0:1788839361.109868:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.109889:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.109977:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839361.110421:0:8483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839361.110667:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788839361.110749:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788839361.110893:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+51:10435:x1875733729285888:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 1193us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.113183:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:3.0:1788839361.139843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839361.140425:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729286016 00000100:00100000:2.0:1788839361.140440:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729286016 00000100:00100000:2.0:1788839361.140533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:2.0:1788839361.140548:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+51:10437:x1875733729286016:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839361.140577:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839361.140608:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640186 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbaffb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140704:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140721:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140732:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140745:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140749:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140753:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140851:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140879:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839361.140943:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788839361.140948:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839361.140975:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140989:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.140999:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141006:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141015:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141021:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839361.141027:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141036:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141101:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839361.141106:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839361.141119:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141126:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d6364018d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141162:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141169:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141175:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141180:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839361.141183:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141190:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141198:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb03866a00) 00010000:00010000:2.0:1788839361.141201:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839361.141204:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141209:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141245:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640186 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141265:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.141271:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:2.0:1788839361.141273:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839361.141274:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebbe00, rc 0) 00000100:00100000:2.0:1788839361.141358:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10437:x1875733729286016:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 815us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839361.141363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00000040:00080000:0.0:1788839361.662847:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839361.662863:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839361.662955:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788839361.662964:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788839361.663165:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f8d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747139712:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839361.663308:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839361.673708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839361.673760:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729286144 00000100:00100000:1.0:1788839361.673772:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729286144 00000100:00100000:1.0:1788839361.673839:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:1.0:1788839361.673853:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729286144:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788839361.673974:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729286144:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 Request processed in 124us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.674446:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f8d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747139712:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788839361.674699:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:0.0:1788839361.693430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839361.695871:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729286272 00000100:00100000:1.0:1788839361.695902:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729286272 00000100:00100000:1.0:1788839361.696012:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:1.0:1788839361.696027:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10448:x1875733729286272:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839361.696122:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839361.696274:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10448:x1875733729286272:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 251us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839361.696300:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:2.0:1788839361.712917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839361.714328:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729286400 00000100:00100000:3.0:1788839361.714350:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729286400 00000100:00100000:1.0:1788839361.716070:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:1.0:1788839361.716089:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10448:x1875733729286400:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788839361.716192:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.716216:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.716232:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.717933:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.717958:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.717972:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718008:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718035:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718043:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839361.718257:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788839361.718263:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839361.718279:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718293:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718300:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718308:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718314:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839361.718319:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718326:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718339:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:0.0:1788839361.718342:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839361.718346:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718363:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636401a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718380:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718386:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718392:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718396:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839361.718399:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718404:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718411:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff91eb08280000) 00010000:00010000:0.0:1788839361.718414:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839361.718416:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718422:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636401a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718440:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718447:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718461:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718466:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839361.718469:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718477:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718485:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:0.0:1788839361.718488:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839361.718491:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.718497:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839361.718732:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10448:x1875733729286400:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 2642us (5824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.718743:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:1.0:1788839361.723259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839361.723353:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729286656 00000100:00100000:3.0:1788839361.723370:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729286656 00000100:00100000:3.0:1788839361.723442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:3.0:1788839361.723456:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10448:x1875733729286656:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839361.723494:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839361.723532:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb002 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723665:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723680:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723691:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839361.723701:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788839361.723824:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723831:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723837:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723842:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839361.723847:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723852:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723865:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:3.0:1788839361.723868:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839361.723872:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723879:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723952:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401b7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb002 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723964:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:3.0:1788839361.723965:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839361.723970:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb002 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.723996:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e200, rc 0) 00000100:00100000:3.0:1788839361.724100:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729286656:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 649us (854us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788839361.724107:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:1.0:1788839361.726497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839361.726791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729286784 00000100:00100000:2.0:1788839361.726800:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729286784 00000100:00100000:2.0:1788839361.726855:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:2.0:1788839361.726867:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729286784:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788839361.726912:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788839361.727023:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729286784:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 158us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839361.727030:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:1.0:1788839361.736406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839361.738689:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729287040 00000100:00100000:2.0:1788839361.738709:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729287040 00000100:00100000:2.0:1788839361.739697:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:2.0:1788839361.739720:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729287040:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839361.739749:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839361.739753:0:8483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788839361.739792:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640178 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaff4 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.739824:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839361.739831:0:8483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839361.739850:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636401cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb009 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839361.740464:0:8483:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788839361.742517:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.742554:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.742566:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.742754:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636401cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb009 expref: 55 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.742801:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb009 expref: 54 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.742811:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280000) 00010000:00010000:0.0:1788839361.742814:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839361.742817:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839361.742907:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10448:x1875733729287040:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 3195us (6516us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788839361.742916:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:2.0:1788839361.748683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839361.748782:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729287296 00000100:00100000:3.0:1788839361.748798:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729287296 00000100:00100000:3.0:1788839361.748884:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:3.0:1788839361.748914:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10448:x1875733729287296:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788839361.749006:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839361.749076:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636401d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb009 expref: 54 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.749105:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280000) 00010000:00010000:3.0:1788839361.749120:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839361.749155:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.749172:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.749183:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.750957:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.750986:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.751016:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752326:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752346:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752356:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752362:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839361.752367:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752376:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752397:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839361.752400:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839361.752405:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636401e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752437:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752443:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752449:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752455:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839361.752458:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752465:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752482:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2c096d45 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839361.752484:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839361.752488:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.752494:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636401e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c096d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839361.752650:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729287296:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 3738us (3977us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839361.752660:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:3.0:1788839361.754713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839361.758649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729287424 00000100:00100000:0.0:1788839361.758671:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729287424 00000100:00100000:0.0:1788839361.758776:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:0.0:1788839361.758791:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10448:x1875733729287424:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839361.758821:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839361.758854:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636401ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb010 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.758915:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.758933:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.758948:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.759106:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636401ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.759140:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.759150:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839361.759154:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788839361.759158:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839361.759252:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10448:x1875733729287424:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 464us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.759261:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:0.0:1788839361.767943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839361.768091:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729287680 00000100:00100000:1.0:1788839361.768104:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729287680 00000100:00100000:1.0:1788839361.768175:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:1.0:1788839361.768186:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10448:x1875733729287680:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788839361.768291:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.768313:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.768328:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839361.768687:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788839361.768712:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344459661354ns, next at 345459659077ns, rc = 0 00000004:00010000:1.0:1788839361.768824:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c91e4bbe reply state 000000004e071efd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839361.768836:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839361.769174:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10448:x1875733729287680:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 986us (1241us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788839361.769183:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 75 00010000:00010000:1.0:1788839361.770620:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.770639:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.770648:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.770654:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9de00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839361.770660:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.770669:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.770690:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:1.0:1788839361.770693:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788839361.770697:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.770704:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636401fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839361.778712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839361.779632:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729287808 00000100:00100000:3.0:1788839361.779649:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729287808 00000100:00100000:3.0:1788839361.779735:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:3.0:1788839361.779748:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10448:x1875733729287808:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839361.779779:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839361.779806:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb017 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.779914:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 56 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.779932:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 56 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.779960:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:3.0:1788839361.779963:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839361.779969:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:3.0:1788839361.780080:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10448:x1875733729287808:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 335us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839361.780087:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:3.0:1788839361.788278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839361.789032:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729287936 00000100:00100000:0.0:1788839361.789046:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729287936 00000100:00100000:0.0:1788839361.789144:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:0.0:1788839361.789155:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875733729287936:12345-192.168.201.9@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788839361.789200:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp t0 exp 0000000000000000 cur 344 last 0 00000020:00000080:0.0:1788839361.789241:0:6697:0:(genops.c:1385:class_connect()) connect: client 07d32060-78a7-4509-9f5d-feb437ccdae6, cookie 0x4b63896d6364020b 00002000:00100000:0.0:1788839361.789256:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07d32060-78a7-4509-9f5d-feb437ccdae6/ffff91eb033c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788839361.789290:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788839361.789608:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788839361.789650:0:6697:0:(import.c:65:import_set_state_nolock()) ffff91eb033cb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839361.789748:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2354:x1875733729287936:12345-192.168.201.9@tcp:8:lhsmtool_posix.0 Request processed in 592us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.789757:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:3.0:1788839361.801564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839361.801698:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729288064 00000100:00100000:2.0:1788839361.801712:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729288064 00000100:00100000:2.0:1788839361.801802:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:2.0:1788839361.801823:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:0:x1875733729288064:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788839361.802239:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839361.833382:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:0:x1875733729288064:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 31545us (31817us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788839361.833400:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000001:00100000:3.0:1788839361.833918:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000001:00080000:3.0:1788839361.833954:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1788839361.841448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839361.841633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729288320 00000100:00100000:2.0:1788839361.841648:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729288320 00000100:00100000:2.0:1788839361.841765:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:2.0:1788839361.841779:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10448:x1875733729288320:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839361.842182:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10448:x1875733729288320:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 406us (746us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788839361.842191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1788839361.852334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839361.852444:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729288576 00000100:00100000:1.0:1788839361.852456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729288576 00000100:00100000:1.0:1788839361.852529:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:1.0:1788839361.852540:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10448:x1875733729288576:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839361.852683:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10448:x1875733729288576:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 143us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839361.852691:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:1.0:1788839361.863791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839361.865029:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729288704 00000100:00100000:0.0:1788839361.865075:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729288704 00000100:00100000:0.0:1788839361.865168:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:0.0:1788839361.865182:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10448:x1875733729288704:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839361.865211:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839361.865246:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640212 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb01e expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.865351:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640219 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.865370:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.865384:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839361.865432:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839361.865458:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.865504:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640212 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb01e expref: 59 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.865527:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb01e expref: 58 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839361.865538:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839361.865540:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788839361.865556:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:0.0:1788839361.865657:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+58:10448:x1875733729288704:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 476us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.865665:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:0.0:1788839361.872641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839361.872796:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729288832 00000100:00100000:1.0:1788839361.872810:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729288832 00000100:00100000:1.0:1788839361.872899:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:1.0:1788839361.872912:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729288832:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839361.872939:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839361.872971:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb025 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839361.873007:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f85c2, blocks: 0x1 00010000:00010000:1.0:1788839361.873034:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1788839361.873038:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839361.873086:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.873134:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839361.873151:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9de00, rc 0) 00000100:00100000:1.0:1788839361.873233:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729288832:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 323us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839361.873240:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:0.0:1788839361.876993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839361.877097:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729289088 00000100:00100000:1.0:1788839361.877110:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729289088 00000100:00100000:1.0:1788839361.877180:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:1.0:1788839361.877193:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+58:10448:x1875733729289088:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839361.877332:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+58:10448:x1875733729289088:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 141us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839361.877340:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:0.0:1788839361.881002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839361.881184:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729289216 00000100:00100000:3.0:1788839361.881197:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729289216 00000100:00100000:3.0:1788839361.881262:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:3.0:1788839361.881276:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:10448:x1875733729289216:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839361.881302:0:9213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839361.881327:0:9213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb02c expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.881369:0:9213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.881380:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839361.881385:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839361.881391:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 7 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.881440:0:9213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.881458:0:9213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 7 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839361.881485:0:9213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03109880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747139840:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839361.881606:0:9213:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb030379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839361.884455:0:9213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03109880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747139840:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839361.884514:0:9213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 7 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839361.884542:0:9213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f600, rc 0) 00000100:00100000:3.0:1788839361.884617:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:10448:x1875733729289216:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 3343us (3628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839361.884627:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:0.0:1788839361.898617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839361.898936:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729289344 00000100:00100000:2.0:1788839361.898951:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729289344 00010000:00010000:2.0:1788839361.899008:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 7 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839361.899095:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:2.0:1788839361.899107:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729289344:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839361.899128:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839361.899160:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 7 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.899178:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 7 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.899214:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f112eb2/0x4b63896d63640220 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb025 expref: 7 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.899265:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839361.899271:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839361.899284:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 6 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.899296:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 6 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839361.899349:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 6 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839361.899368:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1875733747139968:192.168.201.9@tcp:105: 00000100:00100000:2.0:1788839361.899490:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839361.912815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839361.912906:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1875733747139968:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839361.912938:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839361.913007:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fdb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729289344:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 13901us (14407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839361.913022:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:1.0:1788839361.913032:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729289472 00000100:00100000:1.0:1788839361.913114:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729289472 00002000:00100000:1.0:1788839361.913174:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91eb3caf3b80 x1875733729289472/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:507/0 lens 504/0 e 0 to 0 dl 1788839372 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839361.913187:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb3caf3b80 with x1875733729289472 ext(0->8) 00002000:00010000:1.0:1788839361.913193:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb3caf3b80 00000100:00100000:1.0:1788839361.913232:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:1.0:1788839361.913245:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729289472:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788839361.916034:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729289472:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 2489us (2927us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788839361.916172:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00002000:00100000:1.0:1788839361.916187:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91eb3caf3b80 x1875733729289472/t4294967302(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:507/0 lens 504/448 e 0 to 0 dl 1788839372 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839361.916199:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb3caf3b80 with x1875733729289472 ext(0->8) 00002000:00010000:1.0:1788839361.916205:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb3caf3b80 00010000:00010000:1.0:1788839361.917318:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839361.921165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839361.921235:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729289600 00000100:00100000:3.0:1788839361.921252:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729289600 00000100:00100000:3.0:1788839361.921332:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:3.0:1788839361.921344:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+58:10448:x1875733729289600:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788839362.028661:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+58:10448:x1875733729289600:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 107301us (107487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839362.028679:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00000001:00080000:3.0:1788839362.028738:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1788839362.028781:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788839362.028789:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788839362.028814:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788839362.028837:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788839362.028857:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb4063dd80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788839362.028863:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb33130800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb4063d180 00000020:00080000:3.0:1788839362.028866:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb33130e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb3708f000 00000020:00080000:2.0:1788839362.029392:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788839362.029539:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788839362.029551:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839362.029572:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747140224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788839362.029645:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839362.029725:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747140224 00000100:00100000:2.0:1788839362.029734:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747140224 00000100:00100000:2.0:1788839362.029793:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839362.029804:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747140224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788839362.030017:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788839362.030021:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788839362 00002000:00010000:2.0:1788839362.030024:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788839362.030034:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788839362 -> 1788839362 00002000:00010000:2.0:1788839362.030036:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788839362.030116:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747140224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 313us (471us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788839362.030125:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788839362.030148:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788839362.030182:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb1c1a1500/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788839362.030189:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747140224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788839362.031706:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747140096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788839362.031785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839362.033810:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747140096 00000100:00100000:2.0:1788839362.033833:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747140096 00000100:00100000:2.0:1788839362.033938:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839362.033953:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747140096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788839362.033995:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788839362.034042:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f85bf, atime: 0x6a9f85bf, ctime: 0x6a9f85bf, blocks: 0x1 00010000:00010000:2.0:1788839362.034074:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.034096:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1788839362.034102:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839362.034109:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.034129:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.034140:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.034164:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.034187:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788839362.035350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839362.037606:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729289728 00000100:00100000:0.0:1788839362.037629:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729289728 00000100:00100000:0.0:1788839362.037723:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:0.0:1788839362.037736:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729289728:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1788839362.037818:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839362.038913:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747140096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4957us (7120us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788839362.038926:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788839362.038974:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839362.038985:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.039001:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839362.039007:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.039020:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.039045:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.039080:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acd0e118/0x4b63896d6364022e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.039108:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839362.039119:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839362.039121:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788839362.040281:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb03109880/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788839362.040298:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747140096:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1788839362.105084:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839362.105101:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839362.105166:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788839362.105176:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788839362.143841:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1788839362.143888:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1788839362.144240:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729289728:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 106497us (108889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839362.144253:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1788839362.154698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839362.155188:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729289984 00000100:00100000:0.0:1788839362.155201:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729289984 00000100:00100000:0.0:1788839362.155289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:0.0:1788839362.155301:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10448:x1875733729289984:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839362.155378:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839362.155414:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640219 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb01e expref: 13 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.155435:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839362.155441:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839362.155480:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.155498:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.155509:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788839362.156023:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1788839362.156184:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000147b474e reply state 00000000953845c7 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839362.156200:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839362.156398:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+14:10448:x1875733729289984:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1095us (1712us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788839362.156407:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 81 00010000:00010000:1.0:1788839362.159518:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.159539:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.159547:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.159550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:1.0:1788839362.159556:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839362.159562:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.159572:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.159594:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:1.0:1788839362.159598:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839362.159605:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839362.159632:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729290112 00010000:00010000:1.0:1788839362.159634:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640235 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839362.159644:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729290112 00000100:00100000:3.0:1788839362.159738:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:3.0:1788839362.159751:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729290112:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788839362.160176:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788839362.160182:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788839362 -> 1788839361 00002000:00010000:3.0:1788839362.160185:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788839359 00002000:00010000:3.0:1788839362.160187:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788839362 -> 1788839361 00002000:00010000:3.0:1788839362.160190:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788839362.160262:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2357:x1875733729290112:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 512us (715us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788839362.160270:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:3.0:1788839362.161756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.161837:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729290368 00000100:00100000:2.0:1788839362.161849:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729290368 00000100:00100000:2.0:1788839362.161932:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:2.0:1788839362.161945:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10448:x1875733729290368:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788839362.162036:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.162081:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.162092:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.162140:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.162157:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 13 pid: 5843 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.162175:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747140352:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839362.162299:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839362.164274:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747140352:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839362.164314:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839362.164563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839362.164666:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729290496 00000100:00100000:1.0:1788839362.164678:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729290496 00010000:00010000:1.0:1788839362.164726:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 14 pid: 5843 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839362.164766:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:1.0:1788839362.164777:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2358:x1875733729290496:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839362.164799:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839362.164807:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 14 pid: 5843 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.164819:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 14 pid: 5843 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.164842:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636401f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb010 expref: 14 pid: 5843 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.164857:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:1.0:1788839362.164861:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.164874:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.164891:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.165268:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839362.165335:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729290496:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 558us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839362.165344:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00010000:00010000:2.0:1788839362.165553:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165562:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165600:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165607:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165615:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165621:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839362.165626:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165634:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165645:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:2.0:1788839362.165647:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788839362.165651:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.165656:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364023c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.165732:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+12:10448:x1875733729290368:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 3789us (3988us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788839362.165740:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:1.0:1788839362.175639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.175865:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729290624 00000100:00100000:2.0:1788839362.175889:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729290624 00000100:00100000:2.0:1788839362.175966:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:2.0:1788839362.175977:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729290624:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788839362.176029:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.176077:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 7 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.176088:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839362.176092:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839362.176096:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.176135:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 7 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.176148:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 7 pid: 9213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.176163:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875733747140480:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839362.176280:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839362.183238:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875733747140480:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839362.183280:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839362.185599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.185777:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729290752 00000100:00100000:2.0:1788839362.185794:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729290752 00010000:00010000:2.0:1788839362.185860:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 8 pid: 9213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.185937:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:2.0:1788839362.185953:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729290752:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839362.185974:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839362.186007:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 8 pid: 9213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.186023:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 8 pid: 9213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.186074:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b891cbf5/0x4b63896d63640227 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb02c expref: 8 pid: 9213 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.186092:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839362.186097:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839362.186105:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.186119:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.186150:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839362.186241:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2357:x1875733729290752:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 290us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839362.186249:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00010000:00010000:3.0:1788839362.186658:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186670:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186716:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186865:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186877:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186942:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839362.186949:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186959:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186976:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.186984:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7f3077a/0x4b63896d63640243 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839362.193487:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729290624:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 17485us (17835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839362.193509:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:3.0:1788839362.195804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.195938:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729291008 00000100:00100000:2.0:1788839362.195953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729291008 00000100:00100000:2.0:1788839362.196042:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:2.0:1788839362.196085:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+12:10448:x1875733729291008:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788839362.196197:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.196222:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.196236:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.196531:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.196545:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 13 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.196555:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.196603:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 13 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.196620:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 13 pid: 8483 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.196660:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747140608:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839362.199995:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0ad74780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839362.211006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839362.211085:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729291136 00000100:00100000:0.0:1788839362.211095:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729291136 00010000:00010000:0.0:1788839362.211144:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 14 pid: 8483 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839362.211187:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:0.0:1788839362.211198:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2358:x1875733729291136:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839362.211231:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839362.211239:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 14 pid: 8483 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.211256:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 14 pid: 8483 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.211284:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:0.0:1788839362.211290:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.211301:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.211310:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839362.211333:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839362.211399:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2358:x1875733729291136:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 202us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839362.211408:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00010000:00010000:2.0:1788839362.212116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb017 expref: 13 pid: 8483 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.212135:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747140608:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839362.212162:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.212173:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.212179:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839362.212426:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788839362.212607:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788839362.212659:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788839362.214318:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747140736:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788839362.214413:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839362.214496:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0ad74780 going to sleep for 11 seconds 00000100:00100000:2.0:1788839362.222106:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747140736 00000100:00100000:2.0:1788839362.222128:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747140736 00000100:00100000:2.0:1788839362.222222:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839362.222235:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875733747140736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788839362.222416:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875733747140736:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (8004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839362.222436:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839362.222570:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788839362.222578:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb1c1a1500, transno 4294967303 00000100:00100000:3.0:1788839362.222600:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747140736:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788839362.223247:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788839362.223369:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747140864:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788839362.223432:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839362.223471:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb030379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839362.223566:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747140864 00000100:00100000:0.0:1788839362.223573:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747140864 00000100:00100000:0.0:1788839362.223622:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839362.223632:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875733747140864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788839362.223853:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875733747140864:12345-0@lo:1000:mdt00_000.0 Request processed in 222us (421us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788839362.223862:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839362.224137:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747140864:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788839362.224182:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224193:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224202:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224208:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebae00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839362.224213:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224223:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224242:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb08280600) 00010000:00010000:2.0:1788839362.224245:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839362.224251:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224258:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640251 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224318:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224325:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224340:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224345:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839362.224349:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224356:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224367:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:2.0:1788839362.224369:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839362.224372:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224378:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364017f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224404:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224422:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224433:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224468:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.224487:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 16 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.224512:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747140992:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839362.224600:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb012ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839362.229870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.229945:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729291264 00000100:00100000:2.0:1788839362.229958:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729291264 00010000:00010000:2.0:1788839362.230033:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 17 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839362.230104:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:2.0:1788839362.230117:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+17:2357:x1875733729291264:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839362.230138:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839362.230146:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 17 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.230161:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 17 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.230193:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:2.0:1788839362.230199:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.230211:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.230218:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839362.230255:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839362.230320:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+17:2357:x1875733729291264:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 206us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839362.230329:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00010000:00010000:3.0:1788839362.235624:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d6364019b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaffb expref: 16 pid: 5842 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839362.235671:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747140992:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839362.235702:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.235713:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.235719:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236302:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236314:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236323:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236341:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839362.236348:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236357:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236378:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:3.0:1788839362.236382:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839362.236388:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236394:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640258 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236412:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236418:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236424:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236429:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebba00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839362.236431:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236437:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236456:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280f00) 00010000:00010000:3.0:1788839362.236469:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839362.236473:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.236479:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d6364024a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839362.236815:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+15:10448:x1875733729291008:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 40760us (41023us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788839362.236827:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00000020:00080000:3.0:1788839362.236835:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788839362.237187:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839362.237194:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839362.237226:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788839362.237233:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839362.241590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839362.241934:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729291520 00000100:00100000:1.0:1788839362.241952:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729291520 00000100:00100000:1.0:1788839362.242035:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:1.0:1788839362.242070:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+15:10448:x1875733729291520:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788839362.242995:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788839362.243151:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788839362.243212:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.243235:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.243251:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.243261:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.243267:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.243273:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839362.243305:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788839362.243441:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+17:10448:x1875733729291520:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1392us (1862us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788839362.243452:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00010000:00010000:3.0:1788839362.243455:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:1.0:1788839362.243459:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788839362.243473:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.243482:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9da00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839362.243487:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.243497:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.243515:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eb42074400) 00010000:00010000:3.0:1788839362.243518:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788839362.243524:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.243530:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364025f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839362.243560:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839362.243562:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839362.243563:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839362.619436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.619493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.619531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.619561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.619611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839362.619645:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729292160 00000100:00100000:2.0:1788839362.619656:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729292160 00000100:00100000:2.0:1788839362.619722:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729291776 00000100:00100000:2.0:1788839362.619726:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729291776 00000100:00100000:2.0:1788839362.619748:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 141 00000100:00100000:2.0:1788839362.619761:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729292160:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839362.619842:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 142 00000100:00100000:0.0:1788839362.619853:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+17:2356:x1875733729291776:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839362.619883:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729292160:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839362.619892:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 141 00000100:00100000:0.0:1788839362.619905:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+17:2356:x1875733729291776:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 56us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839362.619912:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 142 00000100:00100000:3.0:1788839362.620228:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729291904 00000100:00100000:3.0:1788839362.620234:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729291904 00000100:00100000:1.0:1788839362.620236:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729291648 00000100:00100000:1.0:1788839362.620240:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729291648 00000100:00100000:1.0:1788839362.620271:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 290 00000100:00100000:3.0:1788839362.620275:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729292032 00000100:00100000:3.0:1788839362.620278:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729292032 00000100:00100000:1.0:1788839362.620278:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729291648:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839362.620306:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:1.0:1788839362.620309:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729291648:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 32us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839362.620313:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2356:x1875733729291904:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839362.620315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 290 00000100:00100000:3.0:1788839362.620344:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2356:x1875733729291904:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00080000:1.0:1788839362.620350:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839362.620355:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839362.620362:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:3.0:1788839362.620375:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:3.0:1788839362.620382:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729292032:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839362.620406:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729292032:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839362.620412:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:0.0:1788839362.879662:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747141504:0@lo:400:kworker.0 00000100:00100000:3.0:1788839362.879665:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747141376:0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.879757:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747141248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839362.879821:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747141120:0@lo:400:kworker.0 00000100:00100000:3.0:1788839362.882744:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839362.882941:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747141376 00000100:00100000:3.0:1788839362.882954:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747141376 00000100:00100000:3.0:1788839362.884587:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788839362.884623:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747141376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.884790:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839362.884843:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747141760:0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.884916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839362.884983:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747141248 00000100:00100000:1.0:1788839362.884992:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747141248 00000100:00100000:1.0:1788839362.885065:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788839362.885074:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747141248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.885131:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747141248:12345-0@lo:400:kworker.0 Request processed in 57us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839362.885139:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1788839362.885171:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839362.885188:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747141760 00000100:00100000:1.0:1788839362.885192:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747141760 00000100:00100000:1.0:1788839362.885243:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788839362.885250:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747141760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.885290:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747141760:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839362.885297:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788839362.885977:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747141248:0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.885995:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747141760:0@lo:400:kworker.0 00000100:00100000:2.0:1788839362.889815:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839362.889915:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747141632:0@lo:400:kworker.0 00000100:00100000:2.0:1788839362.889967:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839362.890085:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747141120 00000100:00100000:2.0:1788839362.890099:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747141120 00000100:00100000:2.0:1788839362.890166:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788839362.890178:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747141120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839362.890247:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747141120:12345-0@lo:400:kworker.0 Request processed in 71us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839362.890255:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788839362.890796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839362.891719:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747141504 00000100:00100000:0.0:1788839362.891735:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747141504 00000100:00100000:0.0:1788839362.891807:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788839362.891819:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747141504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839362.892214:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747141504:12345-0@lo:400:kworker.0 Request processed in 396us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839362.892223:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788839362.892280:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747141504:0@lo:400:kworker.0 00000100:00100000:2.0:1788839362.896921:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747141120:0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.897174:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747141632 00000100:00100000:1.0:1788839362.897188:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747141632 00000100:00100000:1.0:1788839362.897298:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788839362.897310:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747141632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839362.897463:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747141632:12345-0@lo:400:kworker.0 Request processed in 155us (7495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839362.897471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788839362.898036:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747141632:0@lo:400:kworker.0 00000100:00080000:0.0:1788839362.898464:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839362.900927:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747141376:12345-0@lo:400:kworker.0 Request processed in 16302us (18192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839362.900977:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788839362.907800:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747141376:0@lo:400:kworker.0 00010000:00010000:2.0:1788839362.941344:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839363.389593:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839363.389631:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747141888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839363.390639:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839363.391123:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747141888 00000100:00100000:3.0:1788839363.391136:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747141888 00000100:00100000:3.0:1788839363.391208:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788839363.391221:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747141888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839363.391279:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839363.391383:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747141888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839363.391391:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788839363.393144:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747141888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839363.906455:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3312b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747142016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839363.906571:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839363.906707:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747142016 00000100:00100000:3.0:1788839363.906719:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747142016 00000100:00100000:3.0:1788839363.906788:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788839363.906800:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747142016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839363.906865:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839363.912659:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747142016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5843us (6071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839363.912681:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788839363.912972:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3312b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747142016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839363.973536:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839364.054764:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839364.054779:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839364.054867:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788839364.054875:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839364.240824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839364.241032:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729292416 00000100:00100000:1.0:1788839364.241073:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729292416 00000100:00100000:1.0:1788839364.241174:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:1.0:1788839364.241189:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+17:10468:x1875733729292416:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839364.241233:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839364.241262:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640266 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb033 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.241417:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364026d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.241435:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364026d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.241450:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364026d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839364.241462:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788839364.241635:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640266 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb033 expref: 20 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.241657:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364026d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb033 expref: 19 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.241667:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839364.241671:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839364.241675:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c600, rc 0) 00000100:00100000:1.0:1788839364.241770:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+19:10468:x1875733729292416:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 584us (962us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788839364.241778:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00080000:2.0:1788839364.241982:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839364.244313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.244565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729292544 00000100:00100000:2.0:1788839364.244578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729292544 00000100:00100000:2.0:1788839364.244668:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:2.0:1788839364.244981:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:10468:x1875733729292544:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:2.0:1788839364.245142:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245166:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245182:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245223:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245232:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245240:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245601:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245612:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245621:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839364.245690:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245708:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245715:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245724:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245731:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839364.245736:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245753:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245768:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839364.245772:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839364.245779:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245786:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364027b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245825:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245854:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245861:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245867:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839364.245871:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245877:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245885:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb03866a00) 00010000:00010000:2.0:1788839364.245887:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839364.245890:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245911:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245938:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245945:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245952:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245959:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebba00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839364.245962:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245970:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245979:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb03866600) 00010000:00010000:2.0:1788839364.245981:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839364.245984:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.245990:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d63640289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839364.246150:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:10468:x1875733729292544:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 1467us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839364.246160:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:3.0:1788839364.282513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839364.287761:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729292800 00000100:00100000:1.0:1788839364.287786:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729292800 00000100:00100000:1.0:1788839364.288043:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:1.0:1788839364.288103:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+19:10471:x1875733729292800:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839364.288134:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839364.288163:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb03a expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288271:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288305:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288320:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288341:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288350:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288357:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288750:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288761:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.288769:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839364.288791:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788839364.289532:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289548:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289556:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289564:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839364.289569:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289580:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289598:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839364.289602:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839364.289608:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289616:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289634:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289641:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289661:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289667:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839364.289671:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289677:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289686:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb42074600) 00010000:00010000:1.0:1788839364.289689:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839364.289692:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289698:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364029e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289764:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 22 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289782:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 21 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.289789:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:1.0:1788839364.289791:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839364.289794:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9ca00, rc 0) 00000100:00100000:1.0:1788839364.290338:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10471:x1875733729292800:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 2235us (8072us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788839364.290362:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:0.0:1788839364.301975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.307164:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729292928 00000100:00100000:2.0:1788839364.307189:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729292928 00000100:00100000:3.0:1788839364.308231:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:3.0:1788839364.308248:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10471:x1875733729292928:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:3.0:1788839364.308348:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308371:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308400:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308456:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308465:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308474:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308481:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839364.308487:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308497:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308518:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:3.0:1788839364.308522:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839364.308530:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.308537:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839364.308653:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10471:x1875733729292928:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 409us (6693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839364.308664:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:2.0:1788839364.317264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.317307:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729293184 00000100:00100000:2.0:1788839364.317320:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729293184 00000100:00100000:2.0:1788839364.317395:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:2.0:1788839364.317423:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10471:x1875733729293184:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839364.317749:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+22:10471:x1875733729293184:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 344us (501us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788839364.317759:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:1.0:1788839364.364709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839364.365010:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729293440 00000100:00100000:0.0:1788839364.365024:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729293440 00000100:00100000:0.0:1788839364.365132:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:0.0:1788839364.365145:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+22:9989:x1875733729293440:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839364.365181:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839364.365211:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636402ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb041 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.365391:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.365967:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 23 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.365981:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.366603:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 23 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.366624:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 23 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839364.366644:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40adca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747142144:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839364.366846:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb053b1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839364.374292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839364.374333:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729293568 00000100:00100000:0.0:1788839364.374345:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729293568 00010000:00010000:0.0:1788839364.374400:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 24 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.374455:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:0.0:1788839364.374467:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+24:2357:x1875733729293568:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839364.374486:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839364.374494:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 24 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.374509:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 24 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.374539:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.374546:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.374581:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.374590:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.374616:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839364.374686:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+24:2357:x1875733729293568:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 221us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839364.374695:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00010000:00010000:0.0:1788839364.374776:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d636402a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb03a expref: 23 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.374794:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40adca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747142144:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839364.374820:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.374831:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.374837:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839364.374872:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788839364.375105:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636402ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.375123:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.375145:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.375148:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839364.375152:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:0.0:1788839364.375183:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+23:9989:x1875733729293440:12345-192.168.201.9@tcp:101:bash.0 Request processed in 10041us (10494us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788839364.375191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:2.0:1788839364.382314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839364.383328:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729293824 00000100:00100000:3.0:1788839364.383370:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729293824 00000100:00100000:3.0:1788839364.383479:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00100000:3.0:1788839364.383494:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+23:9989:x1875733729293824:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:3.0:1788839364.383898:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.383923:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.383940:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839364.384004:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788839364.384035:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d08f74b8 reply state 00000000daa3c7f1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839364.384047:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788839364.384127:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788839364.384270:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+27:9989:x1875733729293824:12345-192.168.201.9@tcp:36:bash.0 Request processed in 778us (1971us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788839364.384279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 89 00000020:00080000:3.0:1788839364.384285:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788839364.391878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.392111:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729293952 00000100:00100000:2.0:1788839364.392127:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729293952 00000100:00100000:2.0:1788839364.392208:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:2.0:1788839364.392221:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+27:9989:x1875733729293952:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839364.392254:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839364.392280:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636402d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb048 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.392362:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636402d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb048 expref: 28 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.392380:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636402d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb048 expref: 28 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.392420:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:2.0:1788839364.392432:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839364.392453:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba800, rc 0) 00000100:00100000:2.0:1788839364.392528:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+28:9989:x1875733729293952:12345-192.168.201.9@tcp:101:bash.0 Request processed in 308us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839364.392536:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 90 00010000:00010000:0.0:1788839364.393307:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.393323:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.393331:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.393339:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.393345:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.393355:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.393372:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.393376:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.393381:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.393388:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636402cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.397723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839364.397932:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729294080 00000100:00100000:1.0:1788839364.397949:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729294080 00000100:00100000:1.0:1788839364.398087:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:1.0:1788839364.398101:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:9989:x1875733729294080:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839364.398126:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839364.398153:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb04f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839364.398189:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f85c1, atime: 0x6a9f85bf, ctime: 0x6a9f85c1, blocks: 0xb 00010000:00010000:1.0:1788839364.398218:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1788839364.398224:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839364.398235:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.398260:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.398294:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c000, rc 0) 00000100:00100000:1.0:1788839364.398374:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:9989:x1875733729294080:12345-192.168.201.9@tcp:101:bash.0 Request processed in 277us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839364.398383:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00080000:2.0:1788839364.398970:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839364.404824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839364.405017:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729294208 00000100:00100000:1.0:1788839364.405032:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729294208 00002000:00010000:1.0:1788839364.405137:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788839364.405144:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb37574a80 with x1875733729294208 ext(0->18446744073709551615) 00002000:00010000:1.0:1788839364.405159:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb37574a80. 00000100:00100000:1.0:1788839364.405206:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:1.0:1788839364.405221:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729294208:12345-192.168.201.9@tcp:10:bash.0 00002000:00010000:1.0:1788839364.406909:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788839364.406921:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788839361 -> 1788839365 00002000:00010000:1.0:1788839364.406926:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788839359 -> 1788839359 00002000:00010000:1.0:1788839364.406929:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788839361 -> 1788839365 00002000:00010000:1.0:1788839364.406931:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788839364.407040:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2355:x1875733729294208:12345-192.168.201.9@tcp:10:bash.0 Request processed in 1815us (2223us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788839364.407074:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00002000:00010000:1.0:1788839364.409134:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788839364.409152:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb37574a80 with x1875733729294208 ext(0->18446744073709551615) 00002000:00010000:1.0:1788839364.409170:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb37574a80. 00000001:00080000:1.0:1788839364.491428:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:1.0:1788839364.491454:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788839364.491485:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1788839364.494624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839364.495184:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729294336 00000100:00100000:3.0:1788839364.495198:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729294336 00000100:00100000:3.0:1788839364.495282:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:3.0:1788839364.495300:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+27:10485:x1875733729294336:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:3.0:1788839364.495405:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.495427:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.495459:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.495478:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.495485:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.495492:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500368:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500396:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500411:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839364.500578:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500606:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500613:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500620:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500626:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.500630:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500638:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500652:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839364.500664:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.500670:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500686:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636402e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500704:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500710:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500716:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500721:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.500724:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500730:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500738:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb0c453800) 00010000:00010000:0.0:1788839364.500741:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.500744:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500750:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636402eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500768:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500780:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500786:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500792:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.500795:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500801:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500809:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.500811:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.500814:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.500820:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.500955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+27:10485:x1875733729294336:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 5655us (6340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839364.500967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:0.0:1788839364.541261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.542102:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729294592 00000100:00100000:2.0:1788839364.542120:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729294592 00000100:00100000:0.0:1788839364.543169:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:0.0:1788839364.543189:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+27:10488:x1875733729294592:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839364.543222:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839364.543253:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb056 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.543384:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.543402:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.543417:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.543437:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.543445:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.543452:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544353:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364030e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544369:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364030e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544380:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364030e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839364.544393:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788839364.544889:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544901:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544918:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544925:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.544930:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544939:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544956:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839364.544959:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.544964:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544971:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640300 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544989:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.544997:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545002:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545008:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.545011:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545027:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545036:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280700) 00010000:00010000:0.0:1788839364.545039:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.545042:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545178:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545250:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636402f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb056 expref: 30 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545268:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364030e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb056 expref: 29 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.545276:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.545278:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788839364.545281:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839364.545443:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10488:x1875733729294592:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 2258us (4197us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788839364.545454:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:3.0:1788839364.549035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.556705:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729294720 00000100:00100000:2.0:1788839364.556731:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729294720 00000100:00100000:2.0:1788839364.558779:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:2.0:1788839364.558813:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10488:x1875733729294720:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:2.0:1788839364.558927:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.558951:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.558961:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.559014:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.559032:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 29 pid: 5844 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839364.559071:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747142272:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839364.559334:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839364.564173:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747142272:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839364.564241:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839364.566370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.566663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729294976 00000100:00100000:2.0:1788839364.566689:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729294976 00000100:00100000:2.0:1788839364.566771:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:2.0:1788839364.566784:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+30:5594:x1875733729294976:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788839364.567575:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+31:5594:x1875733729294976:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 788us (1213us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788839364.567588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:1.0:1788839364.573572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839364.573881:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729295104 00000100:00100000:0.0:1788839364.573895:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729295104 00010000:00010000:0.0:1788839364.573951:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 31 pid: 5844 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.574212:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:0.0:1788839364.574225:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+31:2358:x1875733729295104:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839364.574244:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839364.574252:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 31 pid: 5844 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.574268:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 31 pid: 5844 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.574301:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636402c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb041 expref: 31 pid: 5844 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.574323:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.574330:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.574342:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.574351:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.574445:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839364.574520:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+30:2358:x1875733729295104:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 297us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839364.574528:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00010000:00010000:3.0:1788839364.580222:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.580251:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.587373:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.587400:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.587409:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.587416:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839364.587430:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.587441:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.587464:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:2.0:1788839364.587468:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839364.587473:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.587512:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364031c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839364.587943:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10488:x1875733729294720:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 29140us (38913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839364.587957:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:1.0:1788839364.597460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.597730:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729295360 00000100:00100000:2.0:1788839364.597746:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729295360 00000100:00100000:2.0:1788839364.597830:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:2.0:1788839364.597856:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+29:10488:x1875733729295360:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839364.598242:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+30:10488:x1875733729295360:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 390us (797us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788839364.598252:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:1.0:1788839364.723167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839364.725964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729295616 00000100:00100000:0.0:1788839364.726018:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729295616 00000100:00100000:0.0:1788839364.726169:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:0.0:1788839364.726186:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+30:10499:x1875733729295616:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:0.0:1788839364.726225:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839364.726258:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb05d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.726355:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.726374:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.726389:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.726406:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.726413:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.726419:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727165:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727181:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727191:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839364.727215:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788839364.727345:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727353:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727360:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727367:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.727372:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727380:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727396:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839364.727400:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.727404:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364032a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727425:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727431:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727446:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727452:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.727455:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727461:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727469:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280700) 00010000:00010000:0.0:1788839364.727471:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.727474:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727479:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727537:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb05d expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727552:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb05d expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.727560:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.727562:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839364.727565:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7e00, rc 0) 00000100:00100000:0.0:1788839364.732141:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+32:10499:x1875733729295616:12345-192.168.201.9@tcp:101:cat.0 Request processed in 5937us (8963us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788839364.732192:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:1.0:1788839364.738869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839364.738985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729295872 00000100:00100000:3.0:1788839364.739001:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729295872 00000100:00100000:3.0:1788839364.739124:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:3.0:1788839364.739138:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+32:10499:x1875733729295872:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:3.0:1788839364.739551:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+33:10499:x1875733729295872:12345-192.168.201.9@tcp:35:cat.0 Request processed in 414us (694us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788839364.739560:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:1.0:1788839364.762520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839364.762675:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729296128 00000100:00100000:0.0:1788839364.762827:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729296128 00000100:00100000:0.0:1788839364.763228:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:0.0:1788839364.763256:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+33:10500:x1875733729296128:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:0.0:1788839364.763347:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788839364.763385:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d63640338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb05d expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763413:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364030e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb056 expref: 32 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763439:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636402d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb048 expref: 31 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763477:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb42074400) 00010000:00010000:0.0:1788839364.763492:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839364.763522:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763542:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763554:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763571:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763600:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.763608:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.764657:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.764690:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.764703:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839364.767226:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788839364.767255:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347458203778ns, next at 348458197966ns, rc = 0 00010000:00010000:0.0:1788839364.767372:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.767398:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.767414:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.767805:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.767813:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.767926:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.768027:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839364.768105:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.768112:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.768119:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.768126:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.768132:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.768140:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.768159:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280800) 00010000:00010000:0.0:1788839364.768162:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788839364.768170:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.768177:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640354 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.770419:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.770448:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.770481:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.770488:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839364.770494:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.770503:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.770528:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839364.770534:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839364.770541:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.770548:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640346 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839364.770572:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ef8adc3 reply state 000000002d608d63 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.770586:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839364.774169:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:10500:x1875733729296128:12345-192.168.201.9@tcp:36:rm.0 Request processed in 10907us (11647us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788839364.774188:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 95 00010000:00010000:1.0:1788839364.787360:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.787388:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.787399:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.787407:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839364.787427:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.787437:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.787462:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280700) 00010000:00010000:1.0:1788839364.787467:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839364.787473:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839364.787480:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364034d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.798356:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839364.798381:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.798399:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839364.798406:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.798430:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.798463:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eb08280800) 00010000:00010000:2.0:1788839364.798467:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788839364.798475:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.798523:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364035b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.798564:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839364.798566:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839364.798568:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839364.879778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839364.880166:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729296384 00000100:00100000:2.0:1788839364.880180:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729296384 00000100:00100000:2.0:1788839364.880270:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 96 00000100:00100000:2.0:1788839364.880282:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+31:10506:x1875733729296384:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839364.880319:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839364.880348:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640362 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb064 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.880511:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.880531:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.880545:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.880561:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.880569:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.880577:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788839364.885915:0:8483:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788839364.886668:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887477:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887496:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887560:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887570:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887579:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887586:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839364.887591:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887600:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887631:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:3.0:1788839364.887636:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839364.887651:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.887659:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640369 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839364.889971:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da3fa2a1 reply state 00000000bb827e33 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839364.890284:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788839364.890373:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640362 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 34 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.890435:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 33 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.890448:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:3.0:1788839364.890451:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839364.890456:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f400, rc 0) 00000100:00100000:3.0:1788839364.890569:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+34:10506:x1875733729296384:12345-192.168.201.9@tcp:101:bash.0 Request processed in 10287us (10805us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788839364.890581:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 96 00000100:00100000:1.0:1788839364.902914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839364.905089:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729296512 00000100:00100000:3.0:1788839364.905109:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729296512 00000100:00100000:3.0:1788839364.905214:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:3.0:1788839364.905228:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729296512:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1788839364.905254:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839364.905290:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb06b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839364.905324:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788839364.905348:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1788839364.905353:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839364.905364:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.905425:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.905441:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ee00, rc 0) 00000100:00100000:3.0:1788839364.905524:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729296512:12345-192.168.201.9@tcp:101:bash.0 Request processed in 300us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839364.905532:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00080000:3.0:1788839364.905560:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788839364.907640:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.907666:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.907674:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.907690:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebbe00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839364.907697:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.907707:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.907731:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb03866b00) 00010000:00010000:2.0:1788839364.907735:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839364.907742:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839364.907750:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640370 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839364.912102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839364.912335:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729296640 00000100:00100000:3.0:1788839364.912348:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729296640 00000100:00100000:3.0:1788839364.912431:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:3.0:1788839364.912443:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:10506:x1875733729296640:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1788839364.912468:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839364.912492:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb072 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.912535:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.912545:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839364.912550:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839364.912556:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.912617:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.912653:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 7 pid: 6698 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839364.912670:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875733747142400:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839364.912890:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839364.937505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839364.937548:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729296768 00000100:00100000:0.0:1788839364.937560:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729296768 00010000:00010000:0.0:1788839364.937631:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 8 pid: 6698 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.938141:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:0.0:1788839364.938157:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729296768:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839364.938179:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839364.938211:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 8 pid: 6698 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.938238:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 8 pid: 6698 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.938271:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839364.938276:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839364.938286:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.938298:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839364.938347:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839364.938365:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbe2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1875733747142528:192.168.201.9@tcp:105: 00000100:00100000:0.0:1788839364.938484:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa180 going to sleep for 11 seconds 00010000:00010000:3.0:1788839364.940880:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d63640385 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb06b expref: 8 pid: 6698 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839364.940914:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875733747142400:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839364.940965:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839364.940984:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ea00, rc 0) 00000100:00100000:2.0:1788839364.954287:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:10506:x1875733729296640:12345-192.168.201.9@tcp:101:bash.0 Request processed in 41828us (42217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839364.954304:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:1.0:1788839364.963242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839364.963507:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729297024 00000100:00100000:3.0:1788839364.963520:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729297024 00000100:00100000:3.0:1788839364.963597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:3.0:1788839364.963621:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+33:10506:x1875733729297024:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:3.0:1788839364.964212:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+34:10506:x1875733729297024:12345-192.168.201.9@tcp:35:bash.0 Request processed in 601us (997us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788839364.964233:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:0.0:1788839364.965429:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbe2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1875733747142528:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839364.965479:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839364.965548:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729296768:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 27395us (28058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839364.965559:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00010000:00010000:1.0:1788839364.991668:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839365.164322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839365.164540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729297152 00000100:00100000:2.0:1788839365.164556:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729297152 00000100:00100000:2.0:1788839365.164688:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:2.0:1788839365.164718:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+34:10522:x1875733729297152:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839365.164751:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839365.164779:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb079 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.164884:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364039a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.164912:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364039a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.164927:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364039a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839365.164977:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788839365.164982:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839365.165005:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364039a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.165046:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb079 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.165126:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364039a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb079 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.165135:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839365.165139:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839365.165144:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba400, rc 0) 00000100:00100000:2.0:1788839365.165242:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+35:10522:x1875733729297152:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 525us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839365.165258:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:2.0:1788839365.170462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.170734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729297408 00000100:00100000:0.0:1788839365.170749:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729297408 00000100:00100000:0.0:1788839365.170836:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:0.0:1788839365.170848:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+35:10522:x1875733729297408:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839365.170875:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839365.170904:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636403a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb080 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.171207:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636403a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.171227:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636403a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.171241:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636403a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839365.171257:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788839365.171439:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636403a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb080 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.171459:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636403a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb080 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.171469:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:0.0:1788839365.171490:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839365.171495:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7e00, rc 0) 00000100:00100000:0.0:1788839365.171691:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+37:10522:x1875733729297408:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 843us (1244us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788839365.171699:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:1.0:1788839365.176632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839365.176688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.179125:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729297536 00000100:00100000:3.0:1788839365.179154:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729297536 00000100:00100000:3.0:1788839365.179280:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1788839365.179314:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+37:2356:x1875733729297536:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839365.179341:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839365.179380:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d636403a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb080 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.179519:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:3.0:1788839365.179528:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839365.180274:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+36:2356:x1875733729297536:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 314us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839365.180294:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1788839365.180762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729297792 00000100:00100000:2.0:1788839365.180777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729297792 00000100:00100000:2.0:1788839365.180845:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:2.0:1788839365.180856:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+36:10522:x1875733729297792:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839365.180895:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839365.180923:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb087 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.181104:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636403bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.181123:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636403bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.181137:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636403bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839365.181153:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788839365.182223:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb087 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.182274:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636403bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb087 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.182286:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:2.0:1788839365.182290:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839365.182317:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebaa00, rc 0) 00000100:00100000:2.0:1788839365.183007:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+38:10522:x1875733729297792:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 2147us (6384us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788839365.183603:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:1.0:1788839365.188133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.188341:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729297920 00000100:00100000:3.0:1788839365.188353:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729297920 00000100:00100000:3.0:1788839365.188426:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:3.0:1788839365.188438:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2356:x1875733729297920:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:3.0:1788839365.188507:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.188531:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.188538:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839365.188541:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839365.188545:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.188586:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.188615:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 6 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839365.188630:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747142656:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839365.188743:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839365.190964:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747142656:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839365.191008:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839365.191273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.191743:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729298048 00000100:00100000:0.0:1788839365.191753:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729298048 00002000:00100000:0.0:1788839365.191807:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91eb40adea00 x1875733729298048/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:511/0 lens 504/0 e 0 to 0 dl 1788839376 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788839365.191816:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb40adea00 with x1875733729298048 ext(0->8) 00010000:00010000:0.0:1788839365.191823:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 7 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.191848:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 7 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839365.191857:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb40adea00 00000100:00100000:0.0:1788839365.191937:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:0.0:1788839365.191949:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729298048:12345-192.168.201.9@tcp:4:lfs.0 00000100:00100000:0.0:1788839365.194860:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729298048:12345-192.168.201.9@tcp:4:lfs.0 Request processed in 2895us (3571us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788839365.194877:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00002000:00100000:0.0:1788839365.194896:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91eb40adea00 x1875733729298048/t4294967302(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:511/0 lens 504/448 e 0 to 0 dl 1788839376 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788839365.194908:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb40adea00 with x1875733729298048 ext(0->8) 00010000:00010000:0.0:1788839365.194934:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.194961:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839365.194970:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb40adea00 00000100:00100000:1.0:1788839365.197931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.198161:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729298176 00000100:00100000:3.0:1788839365.198177:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729298176 00010000:00010000:3.0:1788839365.198235:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839365.198283:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:3.0:1788839365.198296:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2355:x1875733729298176:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839365.198322:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788839365.198351:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788839365.198355:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788839365 00002000:00010000:3.0:1788839365.198357:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788839366 00002000:00010000:3.0:1788839365.198359:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788839365 00010000:00010000:3.0:1788839365.198366:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.198407:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.199392:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da32c162/0x4b63896d6364038c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb072 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.199490:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839365.199497:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839365.199505:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.199518:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.199922:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839365.200078:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2355:x1875733729298176:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 1779us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839365.200092:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00010000:00010000:3.0:1788839365.200253:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200267:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200311:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200322:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200356:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200364:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839365.200369:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200379:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200396:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.200404:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001c910be/0x4b63896d636403cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839365.200479:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729297920:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 12043us (12359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839365.200489:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:1.0:1788839365.206015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.206332:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729298432 00000100:00100000:3.0:1788839365.206350:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729298432 00000100:00100000:3.0:1788839365.206450:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:3.0:1788839365.206463:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+38:10522:x1875733729298432:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:3.0:1788839365.206565:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636403bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb087 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839365.206969:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788839365.207017:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788839365.207487:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788839365.207559:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.207580:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 42 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.207591:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.207644:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 42 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.207668:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 42 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839365.207689:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875733747142784:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839365.207843:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788839365.212289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.212454:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875733747142784:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839365.212507:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839365.213208:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729298560 00000100:00100000:0.0:1788839365.213222:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729298560 00010000:00010000:1.0:1788839365.213370:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 43 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839365.213506:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:3.0:1788839365.213521:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+43:2358:x1875733729298560:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839365.213566:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839365.213575:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 43 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.213590:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 43 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.213620:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb064 expref: 43 pid: 8483 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.213643:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:3.0:1788839365.213649:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.213660:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.213669:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.213774:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839365.213935:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+42:2358:x1875733729298560:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 418us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839365.213946:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00010000:00010000:2.0:1788839365.214490:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.214503:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839365.214711:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788839365.215396:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788839365.215713:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747142912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839365.215893:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839365.217546:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05aa4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839365.217659:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747142912 00000100:00100000:0.0:1788839365.217674:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747142912 00000100:00100000:0.0:1788839365.217798:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839365.217820:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747142912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788839365.218207:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839365.218359:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747142912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 550us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839365.218370:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839365.218522:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788839365.218530:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788839365.218561:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb03109880, transno 4294967301 00000100:00100000:3.0:1788839365.218580:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747142912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839365.223373:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788839365.223742:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747143040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839365.223925:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839365.224042:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839365.224174:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747143040 00000100:00100000:0.0:1788839365.224185:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747143040 00000100:00100000:0.0:1788839365.224283:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839365.224297:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747143040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788839365.224584:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875733747143040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 289us (659us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788839365.224593:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839365.224692:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747143040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788839365.224773:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788839365.224850:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.224864:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.224873:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.224880:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839365.224885:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.224895:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.224927:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:3.0:1788839365.224930:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788839365.224936:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.224942:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788839365.225278:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788839365.225397:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788839365.225412:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347916361067ns, next at 348916358169ns, rc = 0 00000001:00080000:3.0:1788839365.225419:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788839365.225467:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:3.0:1788839365.225471:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788839365.225481:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636403bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb087 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839365.225647:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+45:10522:x1875733729298432:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 19186us (19649us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788839365.225656:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000020:00080000:3.0:1788839365.225661:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788839365.228501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.228643:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729298688 00000100:00100000:3.0:1788839365.228660:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729298688 00000100:00100000:3.0:1788839365.228756:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:3.0:1788839365.228769:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+45:10522:x1875733729298688:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839365.228819:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839365.228865:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d636403d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb08e expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.228957:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d636403d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb08e expref: 46 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.228975:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d636403d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb08e expref: 46 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.229000:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:3.0:1788839365.229005:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839365.229010:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f400, rc 0) 00000100:00100000:3.0:1788839365.229121:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+46:10522:x1875733729298688:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 354us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839365.229151:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:1.0:1788839365.233219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839365.233341:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729298944 00000100:00100000:2.0:1788839365.233355:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729298944 00000100:00100000:2.0:1788839365.233521:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:2.0:1788839365.233535:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+46:10522:x1875733729298944:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839365.233887:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10522:x1875733729298944:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 353us (685us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788839365.234016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:1.0:1788839365.306516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839365.306681:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729299072 00000100:00100000:2.0:1788839365.306695:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729299072 00000100:00100000:2.0:1788839365.306775:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:2.0:1788839365.306788:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10532:x1875733729299072:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:2.0:1788839365.306920:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.306943:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.306957:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.306976:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.306983:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.306990:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307157:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307167:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307174:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839365.307254:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307270:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307278:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307285:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307292:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839365.307296:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307305:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307321:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839365.307324:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839365.307331:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307338:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636403e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307376:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307382:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307394:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307399:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839365.307402:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307539:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307549:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb03866b00) 00010000:00010000:2.0:1788839365.307552:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839365.307555:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307562:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636403e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307584:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307591:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307597:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307602:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839365.307605:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307622:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307630:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839365.307633:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839365.307636:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.307642:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636403ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839365.307894:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10532:x1875733729299072:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 1104us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839365.307905:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:1.0:1788839365.350206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.350326:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729299328 00000100:00100000:3.0:1788839365.350342:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729299328 00000100:00100000:3.0:1788839365.350433:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:3.0:1788839365.350447:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+47:10535:x1875733729299328:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839365.350480:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839365.350509:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb095 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.350886:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.350916:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.350933:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.350948:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.350955:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.350960:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351172:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351203:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351211:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839365.351224:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788839365.351367:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351376:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351384:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351390:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839365.351395:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351403:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351760:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:3.0:1788839365.351763:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839365.351770:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351780:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636403fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351798:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351877:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351883:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351888:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839365.351891:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351898:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351918:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb0c453600) 00010000:00010000:3.0:1788839365.351920:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839365.351924:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839365.351931:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640403 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.352506:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636403f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 50 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.352528:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 49 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.352536:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839365.352538:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839365.352542:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:2.0:1788839365.352773:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+49:10535:x1875733729299328:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 2327us (2579us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788839365.352783:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:1.0:1788839365.357386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.357620:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729299456 00000100:00100000:0.0:1788839365.357634:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729299456 00000100:00100000:0.0:1788839365.357747:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 103 00000100:00100000:0.0:1788839365.357761:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+49:10535:x1875733729299456:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1788839365.357911:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.357935:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.357950:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.357984:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.357992:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.358000:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.358006:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839365.358012:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.358021:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.358035:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839365.358039:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839365.358044:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.358207:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839365.358312:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+49:10535:x1875733729299456:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 553us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839365.358320:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 103 00000100:00100000:1.0:1788839365.361020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839365.361188:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729299712 00000100:00100000:3.0:1788839365.361203:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729299712 00000100:00100000:3.0:1788839365.361267:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:3.0:1788839365.361280:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+49:10535:x1875733729299712:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1788839365.361631:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10535:x1875733729299712:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 352us (625us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788839365.361641:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:1.0:1788839365.437257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.437364:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729299968 00000100:00100000:0.0:1788839365.437375:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729299968 00000100:00100000:0.0:1788839365.437441:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:0.0:1788839365.437450:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10545:x1875733729299968:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839365.437480:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839365.437483:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788839365.437516:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364039a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb079 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.437555:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839365.437559:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839365.437574:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364041f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb09c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.437733:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.437747:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 50 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.437754:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.437787:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 50 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.437806:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 50 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839365.437863:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbe1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747143168:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839365.438020:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839365.441894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.442193:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbe1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747143168:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839365.442239:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839365.442354:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729300096 00000100:00100000:2.0:1788839365.442364:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729300096 00010000:00010000:2.0:1788839365.442441:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 51 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839365.442492:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:2.0:1788839365.442503:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+51:2358:x1875733729300096:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839365.442524:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839365.442533:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 51 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.442548:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 51 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.442586:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d6364040a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb095 expref: 51 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.442613:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839365.442619:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.442631:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.442641:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.442671:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839365.442742:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+50:2358:x1875733729300096:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 239us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839365.442750:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00010000:00010000:0.0:1788839365.445444:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.445466:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839365.445494:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788839365.445723:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364041f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.445757:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.445768:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839365.445772:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839365.445775:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839365.445867:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10545:x1875733729299968:12345-192.168.201.9@tcp:101:bash.0 Request processed in 8416us (8620us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788839365.445904:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:1.0:1788839365.451463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839365.451670:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729300352 00000100:00100000:2.0:1788839365.451683:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729300352 00000100:00100000:2.0:1788839365.451781:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 105 00000100:00100000:2.0:1788839365.451792:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+50:10545:x1875733729300352:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:2.0:1788839365.452186:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.452203:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.452213:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839365.452257:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788839365.452275:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fef2beaf reply state 00000000ab5644b3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839365.452282:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839365.452380:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10545:x1875733729300352:12345-192.168.201.9@tcp:36:bash.0 Request processed in 589us (936us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788839365.452389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 105 00000020:00080000:2.0:1788839365.452395:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788839365.453879:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.453898:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.453906:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.453932:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839365.453938:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.453947:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.453970:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839365.453973:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839365.453978:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.453984:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640434 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839365.454956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839365.455080:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729300480 00000100:00100000:2.0:1788839365.455094:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729300480 00000100:00100000:2.0:1788839365.455162:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:2.0:1788839365.455175:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10545:x1875733729300480:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839365.455208:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839365.455231:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364043b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0a3 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.455356:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.455369:0:8483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.455376:0:8483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.455416:0:8483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.455428:0:8483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 53 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839365.455440:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747143296:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839365.455547:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839365.457452:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747143296:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839365.457462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:2.0:1788839365.457488:0:8483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839365.457593:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729300608 00000100:00100000:0.0:1788839365.457604:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729300608 00010000:00010000:0.0:1788839365.457653:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 54 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839365.457724:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:0.0:1788839365.457733:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+54:2357:x1875733729300608:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839365.457755:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839365.457764:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 54 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.457778:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 54 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.457808:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640426 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb09c expref: 54 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.457836:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839365.457842:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.457855:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.457867:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.458008:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839365.458113:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+53:2357:x1875733729300608:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 380us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839365.458124:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00010000:00010000:2.0:1788839365.458311:0:8483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.458320:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839365.458387:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788839365.458400:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839365.458432:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.458471:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d6364043b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 53 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.458510:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 52 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.458519:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839365.458522:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839365.458525:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb200, rc 0) 00000100:00100000:2.0:1788839365.459550:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10545:x1875733729300480:12345-192.168.201.9@tcp:101:bash.0 Request processed in 4364us (4593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839365.459562:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:3.0:1788839365.462204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839365.462257:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729300864 00000100:00100000:2.0:1788839365.462271:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729300864 00000100:00100000:2.0:1788839365.462368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:2.0:1788839365.462378:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+52:10545:x1875733729300864:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:2.0:1788839365.462673:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10545:x1875733729300864:12345-192.168.201.9@tcp:35:bash.0 Request processed in 295us (481us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788839365.462681:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:3.0:1788839365.520320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.520456:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729300992 00000100:00100000:0.0:1788839365.520471:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729300992 00000100:00100000:0.0:1788839365.520556:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:0.0:1788839365.520569:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+53:10551:x1875733729300992:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839365.520614:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839365.520645:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.520737:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.520756:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.520771:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839365.520835:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788839365.520840:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839365.520863:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.520896:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0aa expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.520944:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0aa expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.520955:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839365.520958:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839365.520964:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839365.521111:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10551:x1875733729300992:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 484us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839365.521120:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:3.0:1788839365.526317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.526539:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729301120 00000100:00100000:0.0:1788839365.526554:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729301120 00000100:00100000:0.0:1788839365.526817:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 108 00000100:00100000:0.0:1788839365.526843:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10551:x1875733729301120:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839365.526871:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839365.526899:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0b1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.526986:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527006:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527022:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527040:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527088:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527095:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527213:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364046c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527240:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364046c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527247:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364046c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839365.527297:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788839365.527302:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839365.527325:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364046c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527340:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364046c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527350:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527358:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527366:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527385:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839365.527390:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527399:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527482:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839365.527486:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839365.527491:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527498:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364045e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527512:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527519:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527525:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527530:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839365.527532:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527540:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527558:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280500) 00010000:00010000:0.0:1788839365.527560:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839365.527563:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527570:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527772:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b1 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527788:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364046c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b1 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.527796:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839365.527799:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839365.527802:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:0.0:1788839365.527976:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10551:x1875733729301120:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1136us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839365.527987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 108 00000100:00100000:3.0:1788839365.535101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839365.535312:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729301248 00000100:00100000:1.0:1788839365.535325:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729301248 00000100:00100000:1.0:1788839365.535407:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1788839365.535421:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+55:2356:x1875733729301248:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839365.535447:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839365.535487:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364046c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b1 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.535514:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839365.535521:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839365.535608:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+54:2356:x1875733729301248:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 189us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839365.535640:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:3.0:1788839365.537168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839365.537368:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729301504 00000100:00100000:0.0:1788839365.537381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729301504 00000100:00100000:0.0:1788839365.537461:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00100000:0.0:1788839365.537474:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10551:x1875733729301504:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839365.537503:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839365.537528:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640473 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.537783:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.537802:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 55 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.537812:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.537884:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 55 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839365.537901:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 55 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839365.537917:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbe1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747143424:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839365.538031:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839365.546206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839365.547360:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729301632 00000100:00100000:1.0:1788839365.547375:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729301632 00010000:00010000:1.0:1788839365.547427:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 56 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839365.547466:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:1.0:1788839365.547475:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+56:2358:x1875733729301632:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839365.547497:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839365.547506:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 56 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.547522:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 56 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.547551:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839365.547559:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.547569:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.547577:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.547612:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839365.547687:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+56:2358:x1875733729301632:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 212us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839365.547711:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00010000:00010000:0.0:1788839365.551791:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0a3 expref: 55 pid: 8483 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839365.551861:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbe1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747143424:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839365.551897:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.555666:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.555690:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839365.555757:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788839365.556013:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640473 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.556040:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.556078:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839365.556082:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839365.556087:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6200, rc 0) 00000100:00100000:2.0:1788839365.556194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10551:x1875733729301504:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 18722us (19039us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788839365.556205:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00100000:3.0:1788839365.559934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839365.560032:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729301888 00000100:00100000:1.0:1788839365.560045:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729301888 00000100:00100000:1.0:1788839365.560134:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:1.0:1788839365.560144:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10551:x1875733729301888:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:1.0:1788839365.560160:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839365.560187:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d636403d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb08e expref: 55 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.560205:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839365.560210:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839365.560407:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10551:x1875733729301888:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 259us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839365.560414:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1788839365.562826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839365.562927:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729302016 00000100:00100000:2.0:1788839365.562942:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729302016 00000100:00100000:2.0:1788839365.563022:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 110 00000100:00100000:2.0:1788839365.563037:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10551:x1875733729302016:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:2.0:1788839365.563257:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.563281:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839365.563295:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839365.563609:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788839365.563728:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10551:x1875733729302016:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 692us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839365.563737:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 110 00000100:00100000:2.0:1788839365.566738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839365.566837:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729302144 00000100:00100000:1.0:1788839365.566853:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729302144 00000100:00100000:1.0:1788839365.566933:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 111 00000100:00100000:1.0:1788839365.566947:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+54:10551:x1875733729302144:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839365.566977:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839365.567006:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.567373:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.567387:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.567730:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.567748:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.567768:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839365.567772:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839365.567776:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839365.567785:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d400, rc 0) 00000100:00100000:1.0:1788839365.567944:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10551:x1875733729302144:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 999us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839365.567953:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 111 00010000:00010000:2.0:1788839366.013472:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839366.337284:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839366.337299:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839366.337379:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788839366.337398:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839366.337860:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fe680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747143552:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788839366.338028:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0f8d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839366.349343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839366.349668:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fe680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747143552:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788839366.350150:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729302272 00000100:00100000:3.0:1788839366.350163:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729302272 00000100:00100000:3.0:1788839366.350268:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:3.0:1788839366.350281:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10552:x1875733729302272:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788839366.350327:0:8483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788839366.350491:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10552:x1875733729302272:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 212us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839366.350501:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00080000:2.0:1788839366.352214:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839366.365859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.366096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729302400 00000100:00100000:2.0:1788839366.366110:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729302400 00000100:00100000:2.0:1788839366.366184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:2.0:1788839366.366198:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10552:x1875733729302400:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788839366.366304:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.366330:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.366347:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.367942:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.367966:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.367994:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368030:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368039:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368138:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839366.368239:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788839366.368245:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839366.368266:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368280:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368286:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368294:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368300:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839366.368305:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368312:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368333:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:2.0:1788839366.368336:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839366.368340:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368347:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640496 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368378:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368384:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368390:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368395:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839366.368398:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368404:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368411:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff91eb03866b00) 00010000:00010000:2.0:1788839366.368413:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839366.368416:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368422:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d6364049d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368452:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368468:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368474:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368479:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebaa00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839366.368482:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368487:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368495:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839366.368498:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839366.368500:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.368506:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.368948:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10552:x1875733729302400:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 2747us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839366.368959:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:1.0:1788839366.379179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.379347:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729302656 00000100:00100000:3.0:1788839366.379362:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729302656 00000100:00100000:3.0:1788839366.379462:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:3.0:1788839366.379475:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+55:10552:x1875733729302656:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839366.379506:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839366.379534:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636404ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0c6 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380111:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380154:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380168:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839366.380182:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788839366.380340:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380349:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380356:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380363:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839366.380369:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380377:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380768:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:3.0:1788839366.380774:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788839366.380780:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380788:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d636404b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.380866:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636404ab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0c6 expref: 57 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.381226:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:3.0:1788839366.381228:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839366.381234:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d636404ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0c6 expref: 57 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.381245:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ea00, rc 0) 00000100:00100000:3.0:1788839366.381353:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10552:x1875733729302656:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1879us (2188us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788839366.381364:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:3.0:1788839366.385836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.386009:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729302784 00000100:00100000:1.0:1788839366.386023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729302784 00000100:00100000:1.0:1788839366.386150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:1.0:1788839366.386164:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10552:x1875733729302784:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839366.386217:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839366.386361:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10552:x1875733729302784:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 200us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.386370:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:1.0:1788839366.395111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.395239:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729303040 00000100:00100000:2.0:1788839366.395255:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729303040 00000100:00100000:2.0:1788839366.395332:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:2.0:1788839366.395359:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10552:x1875733729303040:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839366.395381:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839366.395384:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788839366.395410:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0aa expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.395429:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:2.0:1788839366.395435:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839366.395450:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0cd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839366.395937:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788839366.396196:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636404c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.396209:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636404c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.396221:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636404c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.396273:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0cd expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.396305:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636404c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0cd expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.396313:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866b00) 00010000:00010000:2.0:1788839366.396316:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839366.396328:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba400, rc 0) 00000100:00100000:2.0:1788839366.396401:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10552:x1875733729303040:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1044us (1303us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788839366.396409:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:0.0:1788839366.404179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.404448:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729303296 00000100:00100000:1.0:1788839366.404469:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729303296 00000100:00100000:1.0:1788839366.404552:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:1.0:1788839366.404565:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10552:x1875733729303296:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788839366.404664:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839366.404713:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636404c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0cd expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.404766:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866b00) 00010000:00010000:1.0:1788839366.404781:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839366.404822:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.404838:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.404850:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406567:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406597:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406612:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406849:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406858:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406890:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406897:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839366.406902:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406909:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406922:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839366.406925:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839366.406930:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406937:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d636404d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406948:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406954:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406960:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.406964:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9de00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839366.406976:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.407271:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.407280:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xee16ffb0 (ffff91eb05a79300) 00010000:00010000:1.0:1788839366.407283:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839366.407286:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.407292:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636404dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee16ffb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.407593:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10552:x1875733729303296:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 3024us (3424us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839366.407604:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:3.0:1788839366.410090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.410231:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729303424 00000100:00100000:2.0:1788839366.410244:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729303424 00000100:00100000:2.0:1788839366.410328:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:2.0:1788839366.410342:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+56:10552:x1875733729303424:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839366.410369:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839366.410400:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0d4 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.410445:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.410462:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.410476:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.410625:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636404e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 58 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.410665:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 57 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.410675:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:2.0:1788839366.410678:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839366.410691:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb000, rc 0) 00000100:00100000:2.0:1788839366.411072:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10552:x1875733729303424:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 708us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839366.411082:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:3.0:1788839366.413996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.414834:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729303680 00000100:00100000:2.0:1788839366.414850:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729303680 00000100:00100000:2.0:1788839366.414943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:2.0:1788839366.414958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+57:10552:x1875733729303680:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839366.415100:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.415121:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.415139:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839366.415465:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788839366.415478:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349106426713ns, next at 350106423357ns, rc = 0 00000004:00010000:2.0:1788839366.415595:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc49568b reply state 00000000ca811c7c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.415606:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839366.415755:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+59:10552:x1875733729303680:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 798us (1773us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788839366.415763:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 119 00010000:00010000:2.0:1788839366.423210:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.423240:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.423264:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.423270:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebbc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839366.423275:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.423284:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.423302:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:2.0:1788839366.423305:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788839366.423311:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.423318:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636404f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.431661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839366.431908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729303808 00000100:00100000:0.0:1788839366.431925:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729303808 00000100:00100000:0.0:1788839366.432010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:0.0:1788839366.432022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+58:10552:x1875733729303808:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839366.432079:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839366.432104:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0db expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.432175:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.432190:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.432211:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:0.0:1788839366.432214:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839366.432217:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839366.432296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+59:10552:x1875733729303808:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 276us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839366.432303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:1.0:1788839366.443192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.443419:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729303936 00000100:00100000:3.0:1788839366.443429:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729303936 00000100:00100000:3.0:1788839366.443512:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:3.0:1788839366.443523:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729303936:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788839366.444381:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839366.445219:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729303936:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 1690us (2029us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788839366.445229:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:3.0:1788839366.473893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.474317:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729304192 00000100:00100000:1.0:1788839366.474332:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729304192 00000100:00100000:1.0:1788839366.474427:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1788839366.474440:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+59:10552:x1875733729304192:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788839366.475137:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+60:10552:x1875733729304192:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 695us (1256us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788839366.475148:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1788839366.477921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.479192:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729304448 00000100:00100000:2.0:1788839366.479213:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729304448 00000100:00100000:2.0:1788839366.479317:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:2.0:1788839366.479332:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+60:10552:x1875733729304448:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788839366.479639:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+60:10552:x1875733729304448:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 309us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839366.479648:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:2.0:1788839366.490552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839366.497255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729304576 00000100:00100000:0.0:1788839366.497280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729304576 00000100:00100000:0.0:1788839366.497381:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:0.0:1788839366.497396:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+60:10552:x1875733729304576:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839366.497425:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839366.497457:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636404ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0e2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.497601:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.497619:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.497634:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839366.497688:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839366.497724:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.497767:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636404ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e2 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.497800:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e2 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.497819:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:0.0:1788839366.497822:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788839366.497826:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839366.497933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+61:10552:x1875733729304576:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 540us (7393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839366.497940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:3.0:1788839366.502776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839366.502922:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729304704 00000100:00100000:0.0:1788839366.502937:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729304704 00000100:00100000:0.0:1788839366.503013:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:0.0:1788839366.503047:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2357:x1875733729304704:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839366.503997:0:9213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839366.504030:0:9213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0e9 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839366.504298:0:9213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f85c7, blocks: 0x1 00010000:00010000:1.0:1788839366.504329:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788839366.504335:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839366.504352:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 10 pid: 9213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.504390:0:9213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 10 pid: 9213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.504408:0:9213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:1.0:1788839366.504549:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+10:2357:x1875733729304704:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1504us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.504558:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:2.0:1788839366.513952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839366.514105:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729304960 00000100:00100000:0.0:1788839366.514119:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729304960 00000100:00100000:0.0:1788839366.514193:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:0.0:1788839366.514207:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+61:10552:x1875733729304960:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788839366.514365:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+61:10552:x1875733729304960:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 162us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839366.514374:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:2.0:1788839366.517659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.517896:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729305088 00000100:00100000:1.0:1788839366.517910:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729305088 00000100:00100000:1.0:1788839366.517986:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1788839366.518000:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+10:10552:x1875733729305088:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839366.518023:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839366.518093:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0f0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.518136:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 11 pid: 9213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.518147:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839366.518152:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839366.518158:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.518201:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 11 pid: 9213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.518226:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 11 pid: 9213 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.518243:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875733747143680:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839366.518370:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb053b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839366.526711:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875733747143680:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839366.526777:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.526822:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d600, rc 0) 00000100:00100000:1.0:1788839366.526931:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+11:10552:x1875733729305088:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 8932us (9286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.526943:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:2.0:1788839366.529615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.529865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729305216 00000100:00100000:1.0:1788839366.529889:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729305216 00010000:00010000:1.0:1788839366.529944:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 11 pid: 9213 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.529998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:1.0:1788839366.530010:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+11:2357:x1875733729305216:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839366.530035:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839366.530096:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 11 pid: 9213 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.530136:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 11 pid: 9213 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.530166:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d6364050d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e9 expref: 11 pid: 9213 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.530189:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839366.530195:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839366.530206:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.530219:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.530269:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.530286:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875733747143808:192.168.201.9@tcp:105: 00000100:00100000:1.0:1788839366.530400:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb053b1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839366.536706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839366.536885:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729305344 00000100:00100000:0.0:1788839366.536898:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729305344 00002000:00100000:0.0:1788839366.536965:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91eb409ff800 x1875733729305344/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:512/0 lens 504/0 e 0 to 0 dl 1788839377 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788839366.536978:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb409ff800 with x1875733729305344 ext(0->12) 00002000:00010000:0.0:1788839366.536984:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb409ff800 00000100:00100000:0.0:1788839366.537026:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1788839366.537037:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+11:2358:x1875733729305344:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788839366.537689:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729305344:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 647us (999us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788839366.537714:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00002000:00100000:0.0:1788839366.537723:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91eb409ff800 x1875733729305344/t4294967308(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:512/0 lens 504/448 e 0 to 0 dl 1788839377 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788839366.537752:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb409ff800 with x1875733729305344 ext(0->12) 00002000:00010000:0.0:1788839366.537757:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb409ff800 00000100:00100000:1.0:1788839366.538130:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875733747143808:192.168.201.9@tcp:105: 00010000:00010000:1.0:1788839366.538164:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839366.538202:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+12:2357:x1875733729305216:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 8194us (8602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.538212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:2.0:1788839366.543171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.543282:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729305472 00000100:00100000:3.0:1788839366.543296:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729305472 00000100:00100000:3.0:1788839366.543365:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:3.0:1788839366.543409:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+61:10552:x1875733729305472:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788839366.603394:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:3.0:1788839366.603420:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788839366.603443:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788839366.603464:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788839366.603500:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb104f0480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788839366.603506:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb0ad30e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb104f0600 00000020:00080000:3.0:1788839366.603510:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb0ad30b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb37d9d800 00000020:00080000:3.0:1788839366.603542:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1788839366.603563:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788839366.603604:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb03037000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788839366.603608:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb06159900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb03037300 00000020:00080000:3.0:1788839366.603612:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb06159000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb375d7c00 00000100:00100000:1.0:1788839366.604207:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+15:10552:x1875733729305472:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 60795us (61044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.604218:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:3.0:1788839366.604446:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747143936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788839366.604524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839366.605441:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747143936 00000100:00100000:1.0:1788839366.605455:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747143936 00000100:00100000:1.0:1788839366.605516:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788839366.605526:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747143936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788839366.605562:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788839366.605621:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f85c5, atime: 0x6a9f85c6, ctime: 0x6a9f85c5, blocks: 0x1 00010000:00010000:1.0:1788839366.605632:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.605653:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788839366.605658:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839366.605666:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.605685:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.605705:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.605714:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.605735:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788839366.608022:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875733747143936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2483us (3484us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788839366.608040:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788839366.608125:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839366.608137:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.608152:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839366.608158:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.608172:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.608199:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.608207:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d6364051b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.608235:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839366.608237:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839366.608239:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788839366.608488:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb40adc700/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788839366.608497:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747143936:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788839366.609510:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747144064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788839366.610111:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747144192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788839366.610176:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839366.610411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.610450:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747144192 00000100:00100000:3.0:1788839366.610460:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747144192 00000100:00100000:3.0:1788839366.610521:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729305600 00000100:00100000:3.0:1788839366.610524:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729305600 00000100:00100000:3.0:1788839366.610548:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788839366.610567:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747144192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788839366.611532:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788839366.611541:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788839367 00002000:00010000:3.0:1788839366.611544:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788839366.611546:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788839367 -> 1788839367 00002000:00010000:3.0:1788839366.611549:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788839366.612113:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839366.613228:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839366.613256:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747144064 00000100:00100000:0.0:1788839366.613268:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747144064 00000100:00100000:0.0:1788839366.613326:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:0.0:1788839366.613339:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+12:2357:x1875733729305600:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788839366.613985:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1875733747144192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3414us (3804us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788839366.613997:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788839366.614024:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839366.614033:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747144064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788839366.614075:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788839366.614103:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.614130:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.614142:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788839366.614147:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839366.614153:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.614197:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.614217:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 12 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.614256:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875733747144320:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839366.614365:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f03c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788839366.616433:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb1e5c7b80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788839366.616454:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1e5c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747144192:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1788839366.616559:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788839366.617079:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788839366.624441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.624488:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729305728 00000100:00100000:3.0:1788839366.624500:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729305728 00010000:00010000:3.0:1788839366.624557:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 13 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.624620:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:3.0:1788839366.624634:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729305728:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839366.624653:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839366.624659:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 13 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.624675:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 13 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.624928:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839366.624935:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839366.624942:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.624979:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.625006:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839366.625119:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729305728:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 488us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839366.625127:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00010000:00010000:1.0:1788839366.626549:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004555eca0/0x4b63896d636402dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb04f expref: 12 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.626615:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875733747144320:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839366.626646:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.626661:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.626669:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.626682:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.626700:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.626726:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839366.627157:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839366.627168:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.627179:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839366.627184:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.627196:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.627220:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.627227:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d63640522 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.627251:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839366.627264:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839366.627267:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839366.630082:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3313:x1875733747144064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16015us (17939us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788839366.630100:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1788839366.630196:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb3c8c6a00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788839366.630205:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747144064:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788839366.669034:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1788839366.669095:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788839366.669110:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788839366.669336:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729305600:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 55991us (58918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839366.669351:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:3.0:1788839366.672540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.672639:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729305984 00000100:00100000:2.0:1788839366.672653:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729305984 00000100:00100000:2.0:1788839366.672743:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00100000:2.0:1788839366.672756:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+15:10552:x1875733729305984:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839366.672848:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839366.672885:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0e2 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.672921:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:2.0:1788839366.672928:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839366.672971:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.672990:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.673000:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839366.673355:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e54d48c2 reply state 00000000a02a05cd transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.673367:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839366.674196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+16:10552:x1875733729305984:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1434us (1661us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788839366.674229:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00100000:3.0:1788839366.678293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:0.0:1788839366.678498:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.678515:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.678524:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.678531:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839366.678538:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.678547:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.678572:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:0.0:1788839366.678575:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839366.678603:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.678611:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d63640529 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.678907:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729306112 00000100:00100000:2.0:1788839366.678925:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729306112 00000100:00100000:2.0:1788839366.679036:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:2.0:1788839366.679090:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729306112:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788839366.679431:0:9213:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788839366.679436:0:9213:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788839367 -> 1788839366 00002000:00010000:2.0:1788839366.679439:0:9213:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788839366 00002000:00010000:2.0:1788839366.679441:0:9213:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788839367 -> 1788839366 00002000:00010000:2.0:1788839366.679443:0:9213:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788839366.679542:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729306112:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 494us (1264us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788839366.679551:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:1.0:1788839366.682236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.682350:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729306368 00000100:00100000:3.0:1788839366.682363:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729306368 00000100:00100000:3.0:1788839366.682445:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:3.0:1788839366.682459:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+15:10552:x1875733729306368:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788839366.682572:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.682596:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 15 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.682608:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.682655:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 15 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.682672:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 15 pid: 8483 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.682690:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747144448:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839366.683001:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839366.685621:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747144448:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839366.685683:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.687750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.688019:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729306496 00000100:00100000:2.0:1788839366.688033:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729306496 00010000:00010000:2.0:1788839366.688121:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 16 pid: 8483 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.688169:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:2.0:1788839366.688181:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+16:2357:x1875733729306496:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839366.688203:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839366.688211:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 16 pid: 8483 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.688225:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 16 pid: 8483 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.688265:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636404ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0d4 expref: 16 pid: 8483 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.688304:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:2.0:1788839366.688311:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.688323:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.688331:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.688371:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839366.688454:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+15:2357:x1875733729306496:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 274us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839366.688462:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00010000:00010000:3.0:1788839366.689129:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689144:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689181:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689189:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689196:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689203:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839366.689208:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689217:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689231:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:3.0:1788839366.689234:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788839366.689239:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.689245:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640530 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.689335:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+14:10552:x1875733729306368:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 6877us (7111us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788839366.689345:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:0.0:1788839366.693181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.693322:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729306624 00000100:00100000:1.0:1788839366.693336:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729306624 00000100:00100000:1.0:1788839366.693424:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1788839366.693437:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729306624:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788839366.693497:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.693523:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.693533:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839366.693538:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839366.693543:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.693589:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.693607:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 7 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.693625:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875733747144576:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839366.693733:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb053b1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839366.697466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.697595:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729306752 00000100:00100000:2.0:1788839366.697607:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729306752 00010000:00010000:2.0:1788839366.697665:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 8 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.697727:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:2.0:1788839366.697739:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729306752:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839366.697759:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839366.697808:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 8 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.697853:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 8 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.697887:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839366.697893:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839366.697900:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.697912:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.697940:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839366.698018:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729306752:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 281us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839366.698026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00010000:00010000:3.0:1788839366.698321:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640514 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f0 expref: 7 pid: 6697 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.698342:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1875733747144576:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839366.698371:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698393:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698402:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698436:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698446:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698456:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698479:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ca00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839366.698484:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698495:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698510:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.698519:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640537 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.698582:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729306624:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 5148us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839366.698592:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:3.0:1788839366.703301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.703649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729307008 00000100:00100000:1.0:1788839366.703662:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729307008 00000100:00100000:1.0:1788839366.703750:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 127 00000100:00100000:1.0:1788839366.703781:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:10552:x1875733729307008:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788839366.703929:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.703955:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.703970:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.704762:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.704784:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.704793:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.704853:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.704872:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 15 pid: 5844 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.704889:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747144704:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839366.705027:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb053b16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839366.711380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.711549:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729307136 00000100:00100000:3.0:1788839366.711562:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729307136 00010000:00010000:3.0:1788839366.711623:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 16 pid: 5844 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.711679:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:3.0:1788839366.711703:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+16:2358:x1875733729307136:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839366.711725:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839366.711754:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 16 pid: 5844 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.711769:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 16 pid: 5844 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.711815:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:3.0:1788839366.711822:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.711834:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.711844:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.711870:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839366.712138:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636404f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0db expref: 16 pid: 5844 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.712162:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747144704:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839366.712192:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.712204:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839366.712211:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.712562:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+15:2358:x1875733729307136:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 869us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839366.712572:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00000001:00080000:2.0:1788839366.712918:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788839366.713197:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788839366.713252:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788839366.713376:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875733747144832:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788839366.713987:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839366.714040:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1018d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839366.714222:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747144832 00000100:00100000:1.0:1788839366.714248:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747144832 00000100:00100000:1.0:1788839366.714317:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839366.714329:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875733747144832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788839366.714458:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875733747144832:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.714466:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839366.714638:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788839366.714645:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788839366.714678:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb1e5c7b80, transno 4294967309 00000100:00100000:3.0:1788839366.714712:0:5843:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eb3c8c6a00 x1875733747144064/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788839382 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839366.714727:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875733747144832:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788839366.715556:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788839366.715670:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875733747144960:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788839366.715759:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839366.715822:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839366.715869:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747144960 00000100:00100000:3.0:1788839366.715877:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747144960 00000100:00100000:3.0:1788839366.715920:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839366.715930:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875733747144960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788839366.716182:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1875733747144960:12345-0@lo:1000:mdt00_001.0 Request processed in 252us (421us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788839366.716190:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839366.716245:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875733747144960:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788839366.716291:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.716305:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.716315:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.716322:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839366.716328:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.716337:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.716360:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb03866600) 00010000:00010000:3.0:1788839366.716364:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839366.716369:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.716376:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640545 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718155:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718164:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718173:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718179:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839366.718185:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718195:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718213:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:3.0:1788839366.718217:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839366.718230:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718243:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718254:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.718309:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.718348:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747145088:192.168.201.9@tcp:105: 00000100:00100000:3.0:1788839366.719209:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839366.723443:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747145088:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839366.723486:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723499:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640488 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723566:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723584:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723601:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723614:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723621:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723628:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723634:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839366.723658:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723668:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723684:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839366.723856:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839366.723862:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723869:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364054c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723882:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723889:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723895:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723900:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839366.723904:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723910:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723918:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839366.723921:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788839366.723930:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.723937:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364053e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839366.725829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.725945:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729307264 00000100:00100000:2.0:1788839366.725959:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729307264 00000100:00100000:2.0:1788839366.726043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:2.0:1788839366.726088:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:10551:x1875733729307264:12345-192.168.201.9@tcp:49:lfs.0 00000100:00100000:2.0:1788839366.726285:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:10551:x1875733729307264:12345-192.168.201.9@tcp:49:lfs.0 Request processed in 201us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839366.726294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:1.0:1788839366.728254:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:10552:x1875733729307008:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 24461us (24955us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788839366.728270:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 127 00000020:00080000:1.0:1788839366.728277:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788839366.728542:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839366.728548:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839366.729045:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788839366.729082:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839366.731189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.731304:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729307520 00000100:00100000:1.0:1788839366.731319:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729307520 00000100:00100000:1.0:1788839366.731410:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00100000:1.0:1788839366.731423:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+18:10551:x1875733729307520:12345-192.168.201.9@tcp:58:lfs.0 00000040:00080000:1.0:1788839366.732210:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788839366.732352:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+18:10551:x1875733729307520:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 928us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.732365:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00100000:2.0:1788839366.735669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.735831:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729307776 00000100:00100000:3.0:1788839366.735846:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729307776 00000100:00100000:3.0:1788839366.735934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:3.0:1788839366.735948:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:10552:x1875733729307776:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788839366.736917:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788839366.737046:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788839366.737178:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.737201:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.737215:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.737226:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.737233:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.737241:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839366.737265:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788839366.737419:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+20:10552:x1875733729307776:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1470us (1763us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788839366.737431:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000020:00080000:3.0:1788839366.737439:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788839366.738123:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839366.738133:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.738143:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839366.738149:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.738158:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.738177:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eb0c453600) 00010000:00010000:0.0:1788839366.738180:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788839366.738184:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.738190:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640553 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.738210:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839366.738212:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839366.738213:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839366.770984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839366.771301:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729307904 00000100:00100000:2.0:1788839366.771320:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729307904 00000100:00100000:0.0:1788839366.771597:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 129 00000100:00100000:0.0:1788839366.771610:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:10554:x1875733729307904:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839366.771651:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839366.771688:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364055a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.771806:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.771828:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.771843:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.771862:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.771870:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.771877:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.773597:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.773627:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.773639:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.773715:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.773739:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 21 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839366.773762:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747145216:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839366.774205:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839366.777525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839366.777933:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729308160 00000100:00100000:3.0:1788839366.777949:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729308160 00000100:00100000:3.0:1788839366.778030:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1788839366.778042:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+22:5595:x1875733729308160:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788839366.778436:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+23:5595:x1875733729308160:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 394us (926us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788839366.778445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:0.0:1788839366.780564:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747145216:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839366.780614:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839366.781985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839366.782221:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729308288 00000100:00100000:1.0:1788839366.782233:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729308288 00010000:00010000:1.0:1788839366.782296:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 23 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839366.782349:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:1.0:1788839366.782361:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+23:2357:x1875733729308288:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839366.782391:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839366.782402:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 23 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.782440:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 23 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.782473:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364047a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0b8 expref: 23 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.782495:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839366.782501:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.782512:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.782522:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839366.782556:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839366.782637:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+22:2357:x1875733729308288:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 277us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839366.782646:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00010000:00010000:0.0:1788839366.783310:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783323:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839366.783393:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788839366.783399:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839366.783428:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783443:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783454:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783476:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783483:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783489:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839366.783493:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783501:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783514:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:0.0:1788839366.783517:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839366.783522:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783527:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640561 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783543:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783549:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783555:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783561:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839366.783569:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783577:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783585:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eb08280300) 00010000:00010000:0.0:1788839366.783588:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839366.783592:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783598:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783655:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364055a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f7 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783671:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839366.783678:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839366.783681:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839366.783684:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7e00, rc 0) 00000100:00100000:0.0:1788839366.783755:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10554:x1875733729307904:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 12147us (12787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839366.783763:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 129 00010000:00010000:3.0:1788839367.037649:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839367.632934:0:12106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839367.632951:0:12106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839367.633006:0:12106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788839367.633014:0:12106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839367.736791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839367.736833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839367.736879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839367.736900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839367.736922:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839367.736973:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729308672 00000100:00100000:2.0:1788839367.736985:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729308672 00000100:00100000:2.0:1788839367.737046:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729308800 00000100:00100000:2.0:1788839367.737074:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729308800 00000100:00100000:2.0:1788839367.737130:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:2.0:1788839367.737142:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2356:x1875733729308672:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839367.737238:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2356:x1875733729308672:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839367.737246:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:2.0:1788839367.737266:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:2.0:1788839367.737273:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729308800:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839367.737300:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729308800:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839367.737307:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:1.0:1788839367.737536:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729308416 00000100:00100000:1.0:1788839367.737542:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729308416 00000100:00100000:1.0:1788839367.737595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 292 00000100:00100000:1.0:1788839367.737603:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729308416:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839367.737634:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729308416:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 33us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839367.737641:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 292 00000100:00100000:1.0:1788839367.737689:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729308928 00000100:00100000:1.0:1788839367.737692:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729308928 00000100:00100000:1.0:1788839367.737725:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729308544 00000100:00100000:1.0:1788839367.737728:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729308544 00000100:00100000:1.0:1788839367.737751:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 146 00000100:00100000:1.0:1788839367.737759:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729308928:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839367.737801:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2356:x1875733729308928:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 43us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839367.737808:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 146 00000100:00100000:1.0:1788839367.737822:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 147 00000100:00100000:1.0:1788839367.737828:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+21:2356:x1875733729308544:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839367.737872:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+21:2356:x1875733729308544:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 43us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839367.737879:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 147 00000100:00080000:0.0:1788839367.744788:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839367.744805:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788839367.745230:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839367.745237:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839367.745295:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788839367.745305:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839367.745476:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bff800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747145344:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788839367.751544:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b8e30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839367.753159:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bff800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747145344:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788839367.754890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839367.754944:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729309056 00000100:00100000:3.0:1788839367.754955:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729309056 00000100:00100000:3.0:1788839367.755017:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 130 00000100:00100000:3.0:1788839367.755028:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10566:x1875733729309056:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788839367.755097:0:8483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788839367.755232:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10566:x1875733729309056:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 205us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839367.755260:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 130 00000100:00100000:2.0:1788839367.764699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839367.765690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729309312 00000100:00100000:3.0:1788839367.765708:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729309312 00000100:00100000:3.0:1788839367.765839:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 131 00000100:00100000:3.0:1788839367.765854:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+21:10566:x1875733729309312:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839367.765887:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839367.765914:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63640576 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb0fe expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839367.766047:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364057d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839367.766080:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364057d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839367.766097:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364057d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839367.766110:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788839367.766333:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63640576 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0fe expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839367.766356:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364057d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0fe expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839367.766367:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:2.0:1788839367.766371:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839367.766376:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ee00, rc 0) 00000100:00100000:2.0:1788839367.766467:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+23:10566:x1875733729309312:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 615us (1784us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788839367.766475:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 131 00000100:00100000:3.0:1788839367.769872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839367.769961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839367.770006:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729309568 00000100:00100000:1.0:1788839367.770019:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729309568 00000100:00100000:3.0:1788839367.770104:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729309696 00000100:00100000:3.0:1788839367.770108:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729309696 00000100:00100000:3.0:1788839367.770174:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:3.0:1788839367.770187:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+24:2357:x1875733729309696:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839367.770208:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839367.770241:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364057d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0fe expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839367.770265:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 132 00000100:00100000:1.0:1788839367.770274:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+24:10566:x1875733729309568:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788839367.770289:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:3.0:1788839367.770295:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839367.770361:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+23:2357:x1875733729309696:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 178us (401us total) trans 0 rc 0/0 00010000:00010000:1.0:1788839367.770362:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839367.770369:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00010000:00010000:1.0:1788839367.770380:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770392:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770670:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770680:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770688:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770694:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9da00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839367.770699:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770708:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770718:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839367.770721:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839367.770725:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839367.770731:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d6364058b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839367.770898:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+23:10566:x1875733729309568:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 624us (1039us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788839367.770917:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 132 00000040:00080000:3.0:1788839367.771091:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839367.771097:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839367.773143:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788839367.773170:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788839367.778047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839367.778745:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729309952 00000100:00100000:2.0:1788839367.778772:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729309952 00000100:00100000:2.0:1788839367.779152:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:2.0:1788839367.779175:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+23:10566:x1875733729309952:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788839367.782707:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+24:10566:x1875733729309952:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 3520us (4660us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788839367.782723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:3.0:1788839367.997751:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747145472:0@lo:400:kworker.0 00000100:00100000:3.0:1788839367.997915:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839367.998047:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747145472 00000100:00100000:1.0:1788839367.998084:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747145472 00000100:00100000:1.0:1788839367.998167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788839367.998178:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747145472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839367.998572:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747145600:0@lo:400:kworker.0 00000100:00100000:0.0:1788839367.998621:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839367.998980:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747145472:12345-0@lo:400:kworker.0 Request processed in 801us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839367.998992:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788839367.999045:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747145600 00000100:00100000:1.0:1788839367.999084:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747145600 00000100:00100000:1.0:1788839367.999124:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788839367.999132:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747145600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839367.999185:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747145600:12345-0@lo:400:kworker.0 Request processed in 54us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839367.999192:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788839367.999295:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747145600:0@lo:400:kworker.0 00000100:00100000:1.0:1788839367.999490:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747145728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839367.999526:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839367.999594:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747145728 00000100:00100000:0.0:1788839367.999599:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747145728 00000100:00100000:0.0:1788839367.999645:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788839367.999653:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747145728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839367.999791:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747145472:0@lo:400:kworker.0 00000100:00100000:3.0:1788839367.999816:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747145856:0@lo:400:kworker.0 00000100:00100000:3.0:1788839367.999863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839367.999915:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747145856 00000100:00100000:3.0:1788839367.999919:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747145856 00000100:00100000:3.0:1788839367.999950:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839367.999957:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747145856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839367.999993:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747145856:12345-0@lo:400:kworker.0 Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839368.000000:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839368.000042:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747145856:0@lo:400:kworker.0 00000100:00080000:3.0:1788839368.000098:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839368.000313:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747145728:12345-0@lo:400:kworker.0 Request processed in 659us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839368.000321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788839368.000545:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747146112:0@lo:400:kworker.0 00000100:00100000:0.0:1788839368.000580:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839368.000609:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839368.000615:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747145984:0@lo:400:kworker.0 00000100:00100000:0.0:1788839368.000642:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839368.000666:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747145984 00000100:00100000:0.0:1788839368.000670:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747145984 00000100:00100000:0.0:1788839368.000703:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788839368.000709:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747145984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839368.000746:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747145984:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839368.000751:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788839368.000805:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839368.000828:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747145984:0@lo:400:kworker.0 00000100:00100000:2.0:1788839368.001072:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747146112 00000100:00100000:2.0:1788839368.001080:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747146112 00000100:00100000:2.0:1788839368.001122:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788839368.001130:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875733747146112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839368.001171:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875733747146112:12345-0@lo:400:kworker.0 Request processed in 43us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839368.001177:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788839368.001228:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839368.001247:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747146112:0@lo:400:kworker.0 00000100:00100000:1.0:1788839368.002015:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747145728:0@lo:400:kworker.0 00010000:00010000:0.0:1788839368.061688:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839368.509608:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747146240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839368.509718:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839368.509917:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747146240 00000100:00100000:0.0:1788839368.509929:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747146240 00000100:00100000:0.0:1788839368.510002:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788839368.510015:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747146240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839368.510095:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839368.510166:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747146240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839368.510175:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788839368.510887:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747146240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839369.023093:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839369.023128:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747146368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839369.023233:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839369.023328:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747146368 00000100:00100000:0.0:1788839369.023338:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747146368 00000100:00100000:0.0:1788839369.023408:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788839369.023421:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747146368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839369.023470:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839369.024183:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747146368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 761us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839369.024195:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788839369.024226:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839369.024279:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747146368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839369.085293:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839369.654162:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788839369.654419:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1788839369.654548:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:3.0:1788839369.796768:0:12158:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839369.796783:0:12158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839369.796839:0:12158:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788839369.796862:0:12158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839370.075329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839370.075451:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729310208 00000100:00100000:1.0:1788839370.075465:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729310208 00000100:00100000:1.0:1788839370.075576:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 133 00000100:00100000:1.0:1788839370.075591:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+24:10587:x1875733729310208:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839370.075625:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839370.075655:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d63640592 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb105 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839370.075849:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640599 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839370.075870:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839370.075889:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839370.075914:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788839370.076117:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d63640592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb105 expref: 27 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839370.076141:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640599 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb105 expref: 26 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839370.076150:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839370.076154:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788839370.076158:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d000, rc 0) 00000100:00100000:1.0:1788839370.076237:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+26:10587:x1875733729310208:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 649us (924us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788839370.076245:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 133 00000100:00080000:2.0:1788839370.076555:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839370.094335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839370.094696:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729310336 00000100:00100000:0.0:1788839370.094720:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729310336 00000100:00100000:0.0:1788839370.094802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 134 00000100:00100000:0.0:1788839370.094815:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+26:10587:x1875733729310336:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1788839370.095504:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095532:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095546:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095585:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095592:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095599:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095606:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839370.095612:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095621:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095636:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:0.0:1788839370.095639:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839370.095645:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839370.095664:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839370.095784:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+26:10587:x1875733729310336:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 968us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839370.095794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 134 00010000:00010000:0.0:1788839370.116235:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839370.273328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839370.274869:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729310464 00000100:00100000:3.0:1788839370.274884:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729310464 00000100:00100000:3.0:1788839370.274974:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:3.0:1788839370.274985:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729310464:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:3.0:1788839370.275019:0:9213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839370.275042:0:9213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d636405ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb10c expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839370.275115:0:9213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f85c6, atime: 0x6a9f85c6, ctime: 0x6a9f85c6, blocks: 0xb 00010000:00010000:3.0:1788839370.275137:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1788839370.275154:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839370.275165:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d636405ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb10c expref: 7 pid: 9213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839370.275185:0:9213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d636405ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb10c expref: 7 pid: 9213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839370.275235:0:9213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ee00, rc 0) 00000100:00100000:0.0:1788839370.275363:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2357:x1875733729310464:12345-192.168.201.9@tcp:101:cat.0 Request processed in 378us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839370.275372:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00080000:2.0:1788839370.276334:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839370.286469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839370.286560:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729310592 00000100:00100000:0.0:1788839370.286571:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729310592 00002000:00100000:0.0:1788839370.286621:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91eb409fc700 x1875733729310592/t0(0) o3->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:516/0 lens 488/0 e 0 to 0 dl 1788839381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788839370.286633:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb409fc700 with x1875733729310592 ext(0->4095) 00002000:00010000:0.0:1788839370.286639:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb409fc700 00000100:00100000:0.0:1788839370.286671:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:0.0:1788839370.286680:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729310592:12345-192.168.201.9@tcp:3:cat.0 00000100:00100000:0.0:1788839370.286927:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729310592:12345-192.168.201.9@tcp:3:cat.0 Request processed in 247us (469us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788839370.286935:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00002000:00100000:0.0:1788839370.286941:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91eb409fc700 x1875733729310592/t0(0) o3->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:516/0 lens 488/4536 e 0 to 0 dl 1788839381 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788839370.286950:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb409fc700 with x1875733729310592 ext(0->4095) 00002000:00010000:0.0:1788839370.286953:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb409fc700 00010000:00010000:3.0:1788839371.133229:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839371.642401:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788839371.642433:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788839371.642463:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb104f0540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788839371.642469:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb0ad30000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb104f0b40 00000020:00080000:3.0:1788839371.642473:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb0ad30c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb0335d400 00000020:00080000:2.0:1788839371.642617:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788839371.642922:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:3.0:1788839371.901402:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839371.901413:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839371.901448:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788839371.901456:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788839372.159515:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788839372.193571:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788839372.193591:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788839372.193597:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:1.0:1788839372.860789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839372.860834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839372.860945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839372.860982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839372.861029:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729310848 00000100:00100000:3.0:1788839372.861039:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729310848 00000100:00100000:3.0:1788839372.861136:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 151 00000100:00100000:3.0:1788839372.861146:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2357:x1875733729310848:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839372.861220:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2357:x1875733729310848:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839372.861242:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 151 00000100:00080000:3.0:1788839372.861264:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839372.864896:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729310720 00000100:00100000:0.0:1788839372.864911:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729310720 00000100:00100000:0.0:1788839372.864997:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 294 00000100:00100000:0.0:1788839372.865008:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729310720:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839372.865126:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729310720:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 119us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839372.865133:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 294 00000100:00100000:1.0:1788839372.867125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839372.867313:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729311232 00000100:00100000:0.0:1788839372.867322:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729311232 00000100:00100000:0.0:1788839372.867393:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00100000:0.0:1788839372.867403:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729311232:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839372.867478:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729311232:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839372.867485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00080000:1.0:1788839372.869950:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839372.870378:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729311104 00000100:00100000:2.0:1788839372.870389:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729311104 00000100:00100000:2.0:1788839372.870526:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729310976 00000100:00100000:2.0:1788839372.870530:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729310976 00000100:00100000:0.0:1788839372.870589:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:0.0:1788839372.870601:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729311104:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839372.870712:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729311104:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 113us (9876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839372.870720:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00080000:1.0:1788839372.875411:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839372.875420:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839372.875913:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:2.0:1788839372.877439:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729310976:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839372.877535:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729310976:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 1612us (16551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839372.877544:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:1.0:1788839373.118252:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747146496:0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.118332:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839373.118381:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747147008:0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.118403:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839373.118424:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788839373.118427:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747146624:0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.118442:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839373.118452:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747147136:0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.118468:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839373.118489:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147008 00000100:00100000:1.0:1788839373.118495:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147008 00000100:00100000:1.0:1788839373.118545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747146624 00000100:00100000:1.0:1788839373.118548:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747146624 00000100:00100000:1.0:1788839373.118567:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788839373.118576:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747147008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.118615:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747147008:12345-0@lo:400:kworker.0 Request processed in 41us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839373.118621:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788839373.118637:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788839373.118642:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747146624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.118667:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747146624:12345-0@lo:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839373.118673:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788839373.118699:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839373.118745:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747146624:0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.118753:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747147008:0@lo:400:kworker.0 00000100:00100000:3.0:1788839373.118811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747146496 00000100:00100000:3.0:1788839373.118814:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747146496 00000100:00100000:3.0:1788839373.118841:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788839373.118845:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747146496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839373.118871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747146496:12345-0@lo:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839373.118881:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788839373.118955:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147136 00000100:00100000:0.0:1788839373.118965:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147136 00000100:00100000:0.0:1788839373.119010:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788839373.119018:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747147136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839373.119069:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747147136:12345-0@lo:400:kworker.0 Request processed in 53us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839373.119074:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788839373.119122:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839373.119164:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747146752:0@lo:400:kworker.0 00000100:00100000:2.0:1788839373.119187:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839373.119208:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839373.119212:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747146880:0@lo:400:kworker.0 00000100:00100000:2.0:1788839373.119236:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839373.119295:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747146752 00000100:00100000:3.0:1788839373.119299:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747146752 00000100:00100000:3.0:1788839373.119332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788839373.119337:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747146752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839373.119360:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747146752:12345-0@lo:400:kworker.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839373.119364:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788839373.119403:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747146880 00000100:00100000:0.0:1788839373.119406:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747146880 00000100:00100000:0.0:1788839373.119431:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788839373.119435:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747146880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839373.119459:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747146880:12345-0@lo:400:kworker.0 Request processed in 23us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839373.119462:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788839373.119536:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788839373.119541:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb3c8c6a00, transno 4294967310 00000004:00080000:2.0:1788839373.119558:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788839373.119575:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747146880:0@lo:400:kworker.0 00000100:00100000:2.0:1788839373.119584:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747146752:0@lo:400:kworker.0 00000100:00080000:2.0:1788839373.119594:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839373.119597:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839373.120119:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788839373.120124:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788839373.120134:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb40adc700, transno 4294967304 00000100:00100000:1.0:1788839373.120148:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747147136:0@lo:400:kworker.0 00000100:00100000:1.0:1788839373.120155:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747146496:0@lo:400:kworker.0 00010000:00010000:3.0:1788839373.181795:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839373.641283:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839373.641309:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747147264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839373.641381:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839373.641611:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147264 00000100:00100000:0.0:1788839373.641619:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147264 00000100:00100000:0.0:1788839373.641690:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839373.641701:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747147264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839373.641736:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839373.641791:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747147264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839373.641798:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788839373.642022:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747147264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839374.146915:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747147392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839374.146991:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839374.147117:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147392 00000100:00100000:1.0:1788839374.147125:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147392 00000100:00100000:1.0:1788839374.147177:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788839374.147187:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747147392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839374.147219:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839374.161688:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747147392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14491us (14686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839374.161707:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839374.162797:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747147392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839374.206464:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839375.229295:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839376.256544:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839376.476722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839376.478722:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729311360 00000100:00100000:1.0:1788839376.478737:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729311360 00000100:00100000:1.0:1788839376.478817:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 135 00000100:00100000:1.0:1788839376.478830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10230:x1875733729311360:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788839376.478940:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10230:x1875733729311360:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 Request processed in 113us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839376.478948:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 135 00000100:00080000:3.0:1788839376.479739:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839376.492800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839376.493852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729311616 00000100:00100000:3.0:1788839376.493864:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729311616 00000100:00100000:3.0:1788839376.493936:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:3.0:1788839376.493947:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+13:10230:x1875733729311616:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788839376.494878:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:10230:x1875733729311616:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 929us (2085us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788839376.494888:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000020:00080000:3.0:1788839376.765592:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1788839376.765639:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788839376.765716:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788839376.765728:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788839376.933431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839376.933544:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729311744 00000100:00100000:3.0:1788839376.933555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729311744 00000100:00100000:3.0:1788839376.933651:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 136 00000100:00100000:3.0:1788839376.933662:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:11039:x1875733729311744:12345-192.168.201.9@tcp:101:lsof.0 00010000:00010000:3.0:1788839376.933683:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839376.933718:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636405b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb113 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839376.933788:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839376.933803:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839376.933816:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839376.933853:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788839376.933857:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839376.933899:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839376.933924:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636405b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839376.933944:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839376.933953:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:3.0:1788839376.933971:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839376.933975:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ec00, rc 0) 00000100:00100000:3.0:1788839376.934043:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:11039:x1875733729311744:12345-192.168.201.9@tcp:101:lsof.0 Request processed in 382us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839376.934105:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 136 00000100:00080000:2.0:1788839376.935689:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839377.277222:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839377.980703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839377.980801:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729312000 00000100:00100000:1.0:1788839377.980813:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729312000 00000100:00100000:1.0:1788839377.980882:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:1.0:1788839377.980918:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729312000:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839377.981013:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729312000:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 108us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839377.981021:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:0.0:1788839377.986004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839377.986076:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729311872 00000100:00100000:3.0:1788839377.986087:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729311872 00000100:00100000:3.0:1788839377.986154:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 296 00000100:00100000:3.0:1788839377.986165:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729311872:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839377.986236:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729311872:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839377.986243:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 296 00000100:00100000:0.0:1788839377.986441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839377.986525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839377.986561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839377.986611:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729312384 00000100:00100000:1.0:1788839377.986617:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729312384 00000100:00100000:1.0:1788839377.986664:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 157 00000100:00100000:1.0:1788839377.986672:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2357:x1875733729312384:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839377.986718:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2357:x1875733729312384:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 47us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839377.986726:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 157 00000100:00100000:3.0:1788839377.994626:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729312256 00000100:00100000:2.0:1788839377.994626:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729312128 00000100:00100000:3.0:1788839377.994643:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729312256 00000100:00100000:2.0:1788839377.994644:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729312128 00000100:00100000:2.0:1788839377.994894:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:3.0:1788839377.994921:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:3.0:1788839377.994931:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729312256:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839377.995006:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729312256:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 78us (8444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839377.995013:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:2.0:1788839377.997501:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729312128:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839377.997613:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729312128:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 2708us (11172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839377.997624:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00080000:0.0:1788839377.997806:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839377.997812:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839378.241573:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839378.241654:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839378.241678:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3caf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747147648:0@lo:400:kworker.0 00000100:00100000:2.0:1788839378.241758:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839378.244881:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3caf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747147520:0@lo:400:kworker.0 00000100:00100000:0.0:1788839378.244964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839378.245357:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747147776:0@lo:400:kworker.0 00000100:00100000:1.0:1788839378.245393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839378.245436:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839378.245442:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747147904:0@lo:400:kworker.0 00000100:00100000:1.0:1788839378.245485:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839378.245537:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147648 00000100:00100000:1.0:1788839378.245544:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147648 00000100:00100000:1.0:1788839378.245585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147776 00000100:00100000:1.0:1788839378.245588:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147776 00000100:00100000:1.0:1788839378.245629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788839378.245638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747147648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839378.245826:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747148160:0@lo:400:kworker.0 00000100:00100000:0.0:1788839378.245850:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839378.245863:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839378.245868:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747148032:0@lo:400:kworker.0 00000100:00100000:0.0:1788839378.245886:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839378.245909:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839378.245919:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148032 00000100:00100000:0.0:1788839378.245922:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148032 00000100:00100000:0.0:1788839378.245946:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788839378.245952:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747147776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839378.246000:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747147776:12345-0@lo:400:kworker.0 Request processed in 48us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839378.246007:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788839378.246130:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147904 00000100:00100000:3.0:1788839378.246134:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147904 00000100:00100000:3.0:1788839378.246164:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148160 00000100:00100000:3.0:1788839378.246167:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148160 00000100:00100000:3.0:1788839378.246188:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788839378.246188:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788839378.246194:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747148032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839378.246195:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747147904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839378.246224:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747147904:12345-0@lo:400:kworker.0 Request processed in 30us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839378.246249:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788839378.246262:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788839378.246269:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747148160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839378.246298:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747148160:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839378.246303:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788839378.246344:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747148032:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839378.246353:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788839378.246368:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839378.246377:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839378.246379:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839378.246406:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747148032:0@lo:400:kworker.0 00000100:00100000:0.0:1788839378.246418:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747148160:0@lo:400:kworker.0 00000100:00100000:2.0:1788839378.246419:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747147520 00000100:00100000:2.0:1788839378.246423:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747147520 00000100:00100000:2.0:1788839378.246459:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788839378.246467:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747147520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839378.246507:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747147520:12345-0@lo:400:kworker.0 Request processed in 42us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839378.246507:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747147648:12345-0@lo:400:kworker.0 Request processed in 870us (4748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839378.246513:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839378.246519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788839378.246544:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3375f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747147904:0@lo:400:kworker.0 00000100:00100000:2.0:1788839378.246553:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3caf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747147648:0@lo:400:kworker.0 00000100:00100000:1.0:1788839378.246560:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb1c1a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747147776:0@lo:400:kworker.0 00000100:00100000:0.0:1788839378.246623:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3caf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747147520:0@lo:400:kworker.0 00010000:00010000:3.0:1788839378.301252:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839378.749909:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839378.749936:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747148288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839378.750035:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839378.750188:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148288 00000100:00100000:0.0:1788839378.750197:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148288 00000100:00100000:0.0:1788839378.750249:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839378.750259:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb41a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747148288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839378.750299:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839378.750355:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb41a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747148288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839378.750362:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788839378.750419:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747148288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839379.263719:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb409fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747148416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839379.263795:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839379.263924:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148416 00000100:00100000:0.0:1788839379.263932:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148416 00000100:00100000:0.0:1788839379.263979:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839379.263989:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747148416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839379.264025:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839379.264114:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747148416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839379.264121:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839379.264175:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb409fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747148416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788839379.326932:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839380.352432:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788839380.422745:0:12360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:49:39 (1788839379) 00000040:00080000:0.0:1788839381.119528:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839381.119559:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839381.120805:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788839381.120817:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788839381.373618:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839381.938456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839381.938900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729312640 00000100:00100000:3.0:1788839381.938921:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729312640 00000100:00100000:3.0:1788839381.939009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 137 00000100:00100000:3.0:1788839381.939021:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:11305:x1875733729312640:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839381.939044:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788839381.939195:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788839381.939469:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d636405c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb11a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.939585:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.939599:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.939610:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.939644:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.939652:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.939658:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940023:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940033:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940040:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839381.940072:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788839381.940354:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940363:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940370:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940377:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839381.940381:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940388:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940400:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eb08280c00) 00010000:00010000:0.0:1788839381.940403:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839381.940408:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940414:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940439:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940446:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940452:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940467:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839381.940471:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940477:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940486:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91eb08280d00) 00010000:00010000:0.0:1788839381.940489:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839381.940492:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.940497:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.946076:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d636405c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb11a expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.946181:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb11a expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839381.946191:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:0.0:1788839381.946194:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839381.946198:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839381.946324:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+15:11305:x1875733729312640:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 7305us (7879us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788839381.946334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 137 00000100:00100000:3.0:1788839381.951007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839381.951116:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729312896 00000100:00100000:0.0:1788839381.951138:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729312896 00000100:00100000:0.0:1788839381.951212:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 138 00000100:00100000:0.0:1788839381.951223:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+15:11305:x1875733729312896:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788839381.951327:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+15:11305:x1875733729312896:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 Request processed in 106us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839381.951332:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 138 00000100:00100000:3.0:1788839381.952951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839381.953046:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729312768 00000100:00100000:1.0:1788839381.953094:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729312768 00000100:00100000:1.0:1788839381.953153:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1788839381.953163:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+15:2358:x1875733729312768:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839381.953181:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839381.953207:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb11a expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839381.953242:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:1.0:1788839381.953249:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839381.953343:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2358:x1875733729312768:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 181us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839381.953350:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000040:00080000:0.0:1788839382.141257:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839382.141266:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839382.142329:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788839382.142340:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788839382.398283:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839383.097973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839383.098013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839383.098093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839383.098123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839383.098160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839383.098176:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729313280 00000100:00100000:2.0:1788839383.098189:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729313280 00000100:00100000:1.0:1788839383.098190:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729313536 00000100:00100000:1.0:1788839383.098197:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729313536 00000100:00100000:3.0:1788839383.098256:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729313024 00000100:00100000:3.0:1788839383.098262:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729313024 00000100:00100000:2.0:1788839383.098274:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729313408 00000100:00100000:2.0:1788839383.098279:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729313408 00000100:00100000:0.0:1788839383.098345:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729313152 00000100:00100000:0.0:1788839383.098351:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729313152 00000100:00100000:3.0:1788839383.098384:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 298 00000100:00100000:3.0:1788839383.098414:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729313024:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839383.098488:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729313024:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 77us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839383.098495:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 298 00000100:00100000:3.0:1788839383.098557:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:3.0:1788839383.098565:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729313280:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839383.098607:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729313280:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 43us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839383.098614:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:1.0:1788839383.105869:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 161 00000100:00100000:1.0:1788839383.105890:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2357:x1875733729313536:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839383.105996:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2357:x1875733729313536:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 113us (7946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839383.106005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 161 00000100:00100000:2.0:1788839383.111860:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:2.0:1788839383.111888:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729313408:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839383.111978:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729313408:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 106us (13818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839383.111987:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:1.0:1788839383.115861:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00100000:1.0:1788839383.115881:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2357:x1875733729313152:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839383.116002:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2357:x1875733729313152:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 127us (17878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839383.124750:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00080000:3.0:1788839383.125387:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839383.125395:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839383.125399:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839383.357404:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839383.358021:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747148672:0@lo:400:kworker.0 00000100:00100000:0.0:1788839383.358441:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839383.358587:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148672 00000100:00100000:3.0:1788839383.358594:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148672 00000100:00100000:3.0:1788839383.358641:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788839383.358652:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747148672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839383.358694:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747148800:0@lo:400:kworker.0 00000100:00100000:1.0:1788839383.358726:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839383.358769:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148800 00000100:00100000:1.0:1788839383.358773:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148800 00000100:00100000:0.0:1788839383.358792:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747148544:0@lo:400:kworker.0 00000100:00100000:1.0:1788839383.358805:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788839383.358811:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747148800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839383.358825:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839383.358842:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747148800:12345-0@lo:400:kworker.0 Request processed in 31us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839383.358849:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788839383.358854:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747149184:0@lo:400:kworker.0 00000100:00080000:1.0:1788839383.358873:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839383.358879:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839383.358896:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839383.358902:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747148800:0@lo:400:kworker.0 00000100:00100000:0.0:1788839383.358902:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747149056:0@lo:400:kworker.0 00000100:00100000:1.0:1788839383.358921:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839383.358923:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839383.358925:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747148928:0@lo:400:kworker.0 00000100:00100000:1.0:1788839383.358946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839383.358954:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148544 00000100:00100000:0.0:1788839383.358957:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148544 00000100:00100000:1.0:1788839383.358970:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747149184 00000100:00100000:1.0:1788839383.358973:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747149184 00000100:00100000:0.0:1788839383.358988:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788839383.358995:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747148544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839383.358999:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747148928 00000100:00100000:1.0:1788839383.359001:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747148928 00000100:00100000:1.0:1788839383.359023:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788839383.359029:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747149184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839383.359039:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747148544:12345-0@lo:400:kworker.0 Request processed in 33us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839383.359084:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747149184:12345-0@lo:400:kworker.0 Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839383.359097:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788839383.359097:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788839383.359109:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839383.359115:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747148928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839383.359132:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747149056 00000100:00100000:0.0:1788839383.359136:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747149056 00000100:00100000:1.0:1788839383.359149:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747148928:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839383.359155:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788839383.359176:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839383.359179:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839383.359196:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747148928:0@lo:400:kworker.0 00000100:00100000:1.0:1788839383.359242:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747149184:0@lo:400:kworker.0 00000100:00100000:3.0:1788839383.359248:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747148672:12345-0@lo:400:kworker.0 Request processed in 597us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839383.359253:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747148672:0@lo:400:kworker.0 00000100:00100000:3.0:1788839383.359255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788839383.359261:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747148544:0@lo:400:kworker.0 00000100:00100000:0.0:1788839383.359574:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788839383.359584:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747149056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839383.359621:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747149056:12345-0@lo:400:kworker.0 Request processed in 40us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839383.359627:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788839383.359654:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747149056:0@lo:400:kworker.0 00000100:00080000:1.0:1788839383.359800:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788839383.427464:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839383.871006:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747149312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839383.871539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839383.871725:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747149312 00000100:00100000:3.0:1788839383.871734:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747149312 00000100:00100000:3.0:1788839383.871786:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788839383.871797:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747149312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839383.871835:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839383.872412:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747149312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 615us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839383.872434:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839383.872584:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747149312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839384.079859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839384.079922:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729313664 00000100:00100000:0.0:1788839384.079932:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729313664 00000100:00100000:0.0:1788839384.079998:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 139 00000100:00100000:0.0:1788839384.080010:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:11347:x1875733729313664:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839384.080030:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839384.080080:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb121 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080153:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080169:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080212:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080231:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080238:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080245:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080469:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080478:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080484:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080502:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839384.080507:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080514:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080526:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:0.0:1788839384.080529:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839384.080535:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080553:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636405ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080577:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080583:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080589:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080594:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839384.080597:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080604:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080612:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91eb08280300) 00010000:00010000:0.0:1788839384.080615:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839384.080617:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080623:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636405f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080671:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb121 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080696:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:0.0:1788839384.080699:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839384.080704:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636405e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb121 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.080729:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6200, rc 0) 00000100:00100000:0.0:1788839384.080803:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:11347:x1875733729313664:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 794us (951us total) trans 0 rc 301/301 00000100:00100000:0.0:1788839384.080813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 139 00000100:00100000:2.0:1788839384.086169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839384.086256:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729313920 00000100:00100000:0.0:1788839384.086266:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729313920 00000100:00100000:0.0:1788839384.086321:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 140 00000100:00100000:0.0:1788839384.086334:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+14:11347:x1875733729313920:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:0.0:1788839384.086392:0:8483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839384.086419:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d6363ff64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf5a expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.086439:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:0.0:1788839384.086444:0:8483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839384.086699:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.086724:0:8483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.086733:0:8483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.086778:0:8483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.086792:0:8483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 5 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839384.086807:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747149440:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839384.086913:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839384.089519:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747149440:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839384.089552:0:8483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839384.089765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.089935:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729314048 00000100:00100000:3.0:1788839384.089944:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729314048 00010000:00010000:3.0:1788839384.089986:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 6 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839384.090123:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:0.0:1788839384.090140:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2358:x1875733729314048:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839384.090159:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839384.090167:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 6 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.090191:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 6 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.090224:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636405bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb113 expref: 6 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.090240:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:0.0:1788839384.090251:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.090261:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.090270:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.090302:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839384.090322:0:8483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.090331:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.090355:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839384.090363:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2358:x1875733729314048:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 228us (597us total) trans 0 rc 0/0 00010000:00010000:2.0:1788839384.090369:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839384.090376:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00010000:00010000:2.0:1788839384.090396:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839384.093388:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788839384.093414:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.093425:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.093432:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.093438:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839384.093442:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.093451:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.093471:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb05a79800) 00010000:00010000:0.0:1788839384.093474:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839384.093486:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.093502:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d636405fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839384.093539:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5698add reply state 0000000045b04a47 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839384.093549:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839384.093649:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+15:11347:x1875733729313920:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 7314us (7670us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788839384.093669:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 140 00010000:00010000:3.0:1788839384.099794:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.099810:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.099816:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.099820:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.099824:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.099830:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.099844:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91eb03866c00) 00010000:00010000:3.0:1788839384.099847:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.099851:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.099856:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d63640602 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839384.187978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.189945:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729314176 00000100:00100000:3.0:1788839384.189964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729314176 00000100:00100000:3.0:1788839384.190276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 141 00000100:00100000:3.0:1788839384.190287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+14:11355:x1875733729314176:12345-192.168.201.9@tcp:101:lctl.0 00010000:00010000:3.0:1788839384.190313:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839384.190336:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb128 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.190392:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63640610 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.190402:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63640610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.190410:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63640610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839384.190439:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788839384.190441:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839384.190457:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63640610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.190479:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb128 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.190509:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63640610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb128 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.190518:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:3.0:1788839384.190532:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839384.190536:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e600, rc 0) 00000100:00100000:3.0:1788839384.190602:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+15:11355:x1875733729314176:12345-192.168.201.9@tcp:101:lctl.0 Request processed in 318us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839384.190608:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 141 00000100:00100000:2.0:1788839384.277528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.277624:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729314304 00000100:00100000:3.0:1788839384.277636:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729314304 00000100:00100000:3.0:1788839384.277709:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 142 00000100:00100000:3.0:1788839384.277720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+15:11361:x1875733729314304:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1788839384.277741:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839384.277761:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb12f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.277825:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.277838:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.277848:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.277861:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.277867:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.277873:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278300:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364062c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278309:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364062c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278316:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364062c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839384.278344:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788839384.278348:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839384.278368:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364062c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278382:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278388:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278395:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278401:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.278406:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278413:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278425:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:3.0:1788839384.278435:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.278440:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278446:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d6364061e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278461:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278467:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278472:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278477:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.278479:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278497:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278508:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91eb0c453300) 00010000:00010000:3.0:1788839384.278511:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.278513:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278518:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640625 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278550:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb12f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278575:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364062c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb12f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.278583:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:3.0:1788839384.278585:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788839384.278587:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f600, rc 0) 00000100:00100000:3.0:1788839384.278783:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+16:11361:x1875733729314304:12345-192.168.201.9@tcp:101:bash.0 Request processed in 1063us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839384.278791:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 142 00000100:00100000:1.0:1788839384.287186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.287277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729314560 00000100:00100000:3.0:1788839384.287288:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729314560 00000100:00100000:3.0:1788839384.287344:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 143 00000100:00100000:3.0:1788839384.287355:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+16:11361:x1875733729314560:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1788839384.287377:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839384.287399:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640633 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb136 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.287550:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.287564:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.287575:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.287636:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.287657:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.287665:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839384.290600:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788839384.290890:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.290909:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.290990:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291037:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291044:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291589:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291595:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839384.291600:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291608:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291622:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839384.291638:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839384.291644:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291652:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d6364063a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839384.291669:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5327179 reply state 00000000722c65dd transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839384.291679:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788839384.291799:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640633 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291816:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.291824:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866100) 00010000:00010000:2.0:1788839384.291827:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839384.291829:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebbe00, rc 0) 00000100:00100000:2.0:1788839384.292300:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11361:x1875733729314560:12345-192.168.201.9@tcp:101:bash.0 Request processed in 4566us (4741us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788839384.292309:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 143 00010000:00010000:0.0:1788839384.295846:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.295864:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.295871:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.295878:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839384.295883:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.295891:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.295922:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb0c453f00) 00010000:00010000:0.0:1788839384.295925:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839384.295931:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.295955:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640641 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839384.297344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839384.297450:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729314688 00000100:00100000:0.0:1788839384.297459:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729314688 00000100:00100000:0.0:1788839384.297527:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:0.0:1788839384.297538:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729314688:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839384.297555:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839384.297571:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb13d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839384.297591:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839384.297606:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1788839384.297609:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839384.297615:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.297629:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.297638:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:0.0:1788839384.297688:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729314688:12345-192.168.201.9@tcp:101:bash.0 Request processed in 152us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839384.297695:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:1.0:1788839384.299966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839384.300513:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729314816 00000100:00100000:2.0:1788839384.300523:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729314816 00000100:00100000:2.0:1788839384.300581:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:2.0:1788839384.300592:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:11361:x1875733729314816:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839384.300612:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839384.300631:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb144 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.300669:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.300676:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839384.300679:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839384.300683:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.300721:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.300731:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 7 pid: 6697 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839384.300743:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747149568:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839384.300835:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839384.304301:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747149568:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839384.304354:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839384.304372:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebbc00, rc 0) 00000100:00100000:1.0:1788839384.304428:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:11361:x1875733729314816:12345-192.168.201.9@tcp:101:bash.0 Request processed in 3838us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839384.304464:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:1.0:1788839384.305273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.305405:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729314944 00000100:00100000:3.0:1788839384.305417:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729314944 00010000:00010000:3.0:1788839384.305462:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 7 pid: 6697 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839384.305506:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:3.0:1788839384.305515:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2357:x1875733729314944:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839384.305530:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839384.305552:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 7 pid: 6697 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.305565:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 7 pid: 6697 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.305588:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000548f0ebc/0x4b63896d63640656 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb13d expref: 7 pid: 6697 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.305603:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839384.305607:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839384.305614:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.305635:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.305674:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839384.305688:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10757100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1875733747149696:192.168.201.9@tcp:105: 00000100:00100000:3.0:1788839384.305772:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb06444600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839384.311998:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10757100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1875733747149696:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839384.312072:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839384.312142:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729314944:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 6627us (6872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839384.312153:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:2.0:1788839384.314452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.314624:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729315200 00000100:00100000:3.0:1788839384.314635:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729315200 00000100:00100000:3.0:1788839384.314743:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:3.0:1788839384.314755:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11361:x1875733729315200:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:3.0:1788839384.315231:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11361:x1875733729315200:12345-192.168.201.9@tcp:35:bash.0 Request processed in 476us (788us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788839384.315240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:1.0:1788839384.383905:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839384.383934:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747149824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839384.384014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839384.384269:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747149824 00000100:00100000:3.0:1788839384.384276:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747149824 00000100:00100000:3.0:1788839384.384315:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788839384.384322:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747149824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839384.384352:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839384.384395:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747149824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839384.384400:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788839384.384476:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747149824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839384.406773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839384.406906:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729315456 00000100:00100000:0.0:1788839384.406917:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729315456 00000100:00100000:0.0:1788839384.406984:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 144 00000100:00100000:0.0:1788839384.406995:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11371:x1875733729315456:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839384.407022:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839384.407045:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb14b expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839384.407276:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788839384.407414:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640664 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb14b expref: 21 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.407430:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:0.0:1788839384.407432:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839384.407436:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb14b expref: 21 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.407459:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839384.407577:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11371:x1875733729315456:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 584us (814us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788839384.407583:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 144 00000100:00100000:0.0:1788839384.415473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839384.415697:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729315712 00000100:00100000:1.0:1788839384.415708:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729315712 00000100:00100000:1.0:1788839384.415807:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:1.0:1788839384.415819:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11371:x1875733729315712:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1788839384.416145:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+21:11371:x1875733729315712:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 327us (695us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788839384.416153:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00010000:00010000:3.0:1788839384.447327:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839384.532975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839384.533140:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729315840 00000100:00100000:0.0:1788839384.533166:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729315840 00000100:00100000:0.0:1788839384.533231:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 145 00000100:00100000:0.0:1788839384.533242:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+21:11377:x1875733729315840:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839384.533267:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839384.533289:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb152 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.533350:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.533363:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.533374:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839384.533407:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788839384.533411:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839384.533431:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.533455:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb152 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.533506:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb152 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.533515:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839384.533519:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839384.533522:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839384.533605:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+22:11377:x1875733729315840:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 365us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839384.533612:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 145 00000100:00100000:2.0:1788839384.541371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.541458:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729316096 00000100:00100000:3.0:1788839384.541513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729316096 00000100:00100000:3.0:1788839384.541611:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 146 00000100:00100000:3.0:1788839384.541619:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+22:11377:x1875733729316096:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839384.541637:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839384.541656:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640680 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb159 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.541752:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.541764:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.541772:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839384.541781:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788839384.541885:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640680 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb159 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.541901:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb159 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.542201:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866100) 00010000:00010000:3.0:1788839384.542222:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839384.542226:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e800, rc 0) 00000100:00100000:3.0:1788839384.542307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11377:x1875733729316096:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 687us (944us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788839384.542330:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 146 00000100:00100000:1.0:1788839384.546806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839384.546860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839384.546867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729316352 00000100:00100000:2.0:1788839384.546878:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729316352 00000100:00100000:0.0:1788839384.546948:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729316480 00000100:00100000:0.0:1788839384.546952:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729316480 00000100:00100000:0.0:1788839384.547023:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 147 00000100:00100000:0.0:1788839384.547036:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+25:11377:x1875733729316480:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839384.547089:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839384.547113:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb160 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.547220:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364069c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.547235:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364069c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.547245:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364069c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839384.547257:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788839384.547404:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb160 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.547430:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364069c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb160 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.547437:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866100) 00010000:00010000:0.0:1788839384.547439:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788839384.547454:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839384.547552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+27:11377:x1875733729316480:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 516us (689us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788839384.547560:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 147 00000100:00100000:2.0:1788839384.549648:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839384.549667:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+26:2358:x1875733729316352:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839384.549684:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839384.549722:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb159 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.549740:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866100) 00010000:00010000:2.0:1788839384.549746:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839384.549814:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+25:2358:x1875733729316352:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 156us (3016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839384.549821:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:1.0:1788839384.555461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839384.555539:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729316608 00000100:00100000:0.0:1788839384.555551:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729316608 00000100:00100000:0.0:1788839384.555610:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:0.0:1788839384.555621:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729316608:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:0.0:1788839384.555671:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.555694:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.555703:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788839384.555708:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839384.555712:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.555748:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.555760:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 6 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839384.555771:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875733747149952:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839384.555862:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4063d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839384.560338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.560445:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875733747149952:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839384.560479:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839384.560577:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729316736 00000100:00100000:1.0:1788839384.560585:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729316736 00002000:00100000:1.0:1788839384.560636:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91eb09f75c00 x1875733729316736/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:530/0 lens 504/0 e 0 to 0 dl 1788839395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839384.560645:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb09f75c00 with x1875733729316736 ext(0->12) 00010000:00010000:1.0:1788839384.560652:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 7 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839384.560683:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 7 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839384.560758:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb09f75c00 00000100:00100000:1.0:1788839384.560814:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:1.0:1788839384.560822:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729316736:12345-192.168.201.9@tcp:4:lfs.0 00000100:00100000:1.0:1788839384.562374:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729316736:12345-192.168.201.9@tcp:4:lfs.0 Request processed in 863us (1356us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788839384.562388:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00002000:00100000:1.0:1788839384.562400:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91eb09f75c00 x1875733729316736/t4294967305(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:530/0 lens 504/448 e 0 to 0 dl 1788839395 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839384.562410:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb09f75c00 with x1875733729316736 ext(0->12) 00010000:00010000:1.0:1788839384.562419:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 9 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839384.562436:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 9 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839384.562444:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb09f75c00 00000100:00100000:1.0:1788839384.566287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839384.566384:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729316864 00000100:00100000:0.0:1788839384.566395:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729316864 00010000:00010000:0.0:1788839384.566445:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 9 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839384.566505:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:0.0:1788839384.566516:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2356:x1875733729316864:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839384.566534:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788839384.566560:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788839384.566564:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788839385 00002000:00010000:0.0:1788839384.566567:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788839385 00002000:00010000:0.0:1788839384.566570:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788839385 00010000:00010000:0.0:1788839384.566578:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 9 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.566592:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 9 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.566619:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d6364065d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb144 expref: 9 pid: 6698 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.566640:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839384.566645:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839384.566651:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.566802:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839384.566838:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839384.566920:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2356:x1875733729316864:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 399us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839384.566930:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00010000:00010000:3.0:1788839384.567663:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567676:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567718:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567728:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567736:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567744:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839384.567748:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567757:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567785:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.567792:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005726a919/0x4b63896d636406aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839384.567868:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2357:x1875733729316608:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 12246us (12413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839384.567877:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:1.0:1788839384.571395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.571454:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729317120 00000100:00100000:3.0:1788839384.571463:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729317120 00000100:00100000:3.0:1788839384.571520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:3.0:1788839384.571528:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de38c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+25:11377:x1875733729317120:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:3.0:1788839384.571585:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364069c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb160 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839384.571810:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788839384.571836:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788839384.572530:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788839384.572603:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.572619:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.572629:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.572682:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.572699:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 29 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839384.572715:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875733747150080:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839384.572811:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839384.577149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839384.577229:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875733747150080:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839384.577260:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839384.577317:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729317248 00000100:00100000:3.0:1788839384.577326:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729317248 00010000:00010000:3.0:1788839384.577367:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 30 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839384.577408:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:3.0:1788839384.577418:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+30:2357:x1875733729317248:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839384.577446:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839384.577454:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 30 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.577467:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 30 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.577505:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb136 expref: 30 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.577525:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866100) 00010000:00010000:3.0:1788839384.577530:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.577539:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.577546:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.577573:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839384.577593:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.577600:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839384.577636:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+29:2357:x1875733729317248:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 218us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839384.577644:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000001:00080000:2.0:1788839384.585803:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788839384.586459:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788839384.586588:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747150208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839384.586785:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839384.586820:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839384.586832:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747150208 00000100:00100000:3.0:1788839384.586840:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747150208 00000100:00100000:3.0:1788839384.586894:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839384.586904:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747150208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788839384.587038:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747150208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839384.587098:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839384.587307:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747150208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839384.588663:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788839384.588782:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747150336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839384.588828:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839384.588886:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839384.588924:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747150336 00000100:00100000:3.0:1788839384.588930:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747150336 00000100:00100000:3.0:1788839384.589020:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839384.589030:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875733747150336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788839384.589255:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875733747150336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 226us (423us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788839384.589263:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839384.589329:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875733747150336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839384.589369:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788839384.589397:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.589404:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.589410:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.589414:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839384.589428:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.589434:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.589447:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866100) 00010000:00010000:2.0:1788839384.589449:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788839384.589452:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.589457:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839384.589722:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788839384.589824:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788839384.589835:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367280784046ns, next at 368280781856ns, rc = 0 00000001:00080000:2.0:1788839384.589840:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788839384.589861:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866100) 00010000:00010000:2.0:1788839384.589863:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839384.589869:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d6364069c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb160 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839384.590038:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de38c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11377:x1875733729317120:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 18510us (18650us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788839384.590046:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000020:00080000:2.0:1788839384.590067:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788839384.592774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839384.593747:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729317376 00000100:00100000:2.0:1788839384.593760:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729317376 00000100:00100000:2.0:1788839384.593870:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 148 00000100:00100000:2.0:1788839384.593881:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11377:x1875733729317376:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839384.593938:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839384.593972:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636406b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb167 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.594444:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636406b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb167 expref: 33 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.594457:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636406b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb167 expref: 33 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.594476:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839384.594489:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839384.594493:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba800, rc 0) 00000100:00100000:2.0:1788839384.594555:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+33:11377:x1875733729317376:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 675us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839384.594561:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 148 00000100:00100000:0.0:1788839384.598593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839384.598716:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729317632 00000100:00100000:1.0:1788839384.598728:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729317632 00000100:00100000:1.0:1788839384.598816:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1788839384.598844:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+33:11377:x1875733729317632:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1788839384.599587:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+34:11377:x1875733729317632:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 745us (1004us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788839384.599594:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1788839384.708856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.709389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729317888 00000100:00100000:3.0:1788839384.709400:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729317888 00000100:00100000:2.0:1788839384.711608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 149 00000100:00100000:2.0:1788839384.711623:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+34:11387:x1875733729317888:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839384.711651:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839384.711672:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb16e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839384.711869:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788839384.711998:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb16e expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.712207:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:2.0:1788839384.712227:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839384.712235:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636406bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb16e expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.712252:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb800, rc 0) 00000100:00100000:2.0:1788839384.712336:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+35:11387:x1875733729317888:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 716us (3491us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788839384.712343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 149 00000100:00100000:2.0:1788839384.716813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.716919:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729318016 00000100:00100000:3.0:1788839384.716930:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729318016 00000100:00100000:3.0:1788839384.717001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 150 00000100:00100000:3.0:1788839384.717012:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:11387:x1875733729318016:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:3.0:1788839384.717138:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717167:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717181:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717195:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717202:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717226:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717335:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717344:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717351:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839384.717395:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717407:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717419:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717426:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717432:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.717436:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717443:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717455:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:3.0:1788839384.717474:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.717487:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717494:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717512:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717516:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717522:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717526:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.717528:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717533:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717540:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb0c453300) 00010000:00010000:3.0:1788839384.717542:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.717544:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717549:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717563:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717574:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717579:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717584:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.717586:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717591:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717598:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:3.0:1788839384.717600:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.717603:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.717608:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839384.718042:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:11387:x1875733729318016:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 1030us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839384.718124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 150 00000100:00100000:3.0:1788839384.722868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839384.723351:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729318272 00000100:00100000:2.0:1788839384.723363:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729318272 00000100:00100000:2.0:1788839384.723493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:2.0:1788839384.723506:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+35:11387:x1875733729318272:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839384.723785:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+36:11387:x1875733729318272:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 282us (927us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788839384.723794:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:1.0:1788839384.777835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839384.778569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729318528 00000100:00100000:2.0:1788839384.778579:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729318528 00000100:00100000:3.0:1788839384.778778:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 151 00000100:00100000:3.0:1788839384.778791:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+36:11390:x1875733729318528:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839384.778818:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839384.778843:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d636406e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb175 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.778973:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.778988:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779001:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779023:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779031:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779038:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779183:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779193:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779200:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839384.779209:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788839384.779309:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779317:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779330:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779336:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.779340:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779348:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779359:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:3.0:1788839384.779362:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.779366:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779371:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d636406e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779384:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779390:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779395:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779399:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839384.779401:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779417:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779425:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb0c453300) 00010000:00010000:3.0:1788839384.779427:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839384.779430:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779436:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d636406f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779497:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d636406e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779512:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839384.779520:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:3.0:1788839384.779522:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839384.779524:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e200, rc 0) 00000100:00100000:3.0:1788839384.779607:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+38:11390:x1875733729318528:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 817us (1781us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788839384.779614:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 151 00000100:00100000:3.0:1788839384.782468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839384.782574:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729318656 00000100:00100000:2.0:1788839384.782586:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729318656 00000100:00100000:2.0:1788839384.782643:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00100000:2.0:1788839384.782653:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+38:11390:x1875733729318656:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:2.0:1788839384.782725:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782745:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782776:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782806:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782813:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782819:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782825:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839384.782829:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782837:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782847:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839384.782849:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839384.782853:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839384.782857:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839384.782944:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+38:11390:x1875733729318656:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 290us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839384.782951:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00100000:1.0:1788839384.786570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839384.786621:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729318912 00000100:00100000:3.0:1788839384.786630:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729318912 00000100:00100000:3.0:1788839384.786706:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:3.0:1788839384.786717:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+38:11390:x1875733729318912:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1788839384.786977:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+39:11390:x1875733729318912:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 261us (413us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788839384.786985:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00000001:00080000:2.0:1788839384.957701:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788839384.957749:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1788839385.187819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839385.188706:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729319168 00000100:00100000:0.0:1788839385.188719:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729319168 00000100:00100000:0.0:1788839385.188798:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 153 00000100:00100000:0.0:1788839385.188812:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+39:11422:x1875733729319168:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:0.0:1788839385.188837:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839385.188860:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364070c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb17c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.188959:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.188974:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.189003:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839385.189031:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788839385.189195:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364070c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb17c expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.189230:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb17c expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.189237:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839385.189239:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839385.189241:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:0.0:1788839385.189296:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+41:11422:x1875733729319168:12345-192.168.201.9@tcp:101:cat.0 Request processed in 489us (1487us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788839385.189303:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 153 00000100:00080000:1.0:1788839385.189365:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839385.193399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839385.193506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729319424 00000100:00100000:2.0:1788839385.193516:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729319424 00000100:00100000:2.0:1788839385.193582:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:2.0:1788839385.193593:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+41:11422:x1875733729319424:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:2.0:1788839385.193871:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+42:11422:x1875733729319424:12345-192.168.201.9@tcp:35:cat.0 Request processed in 280us (482us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788839385.193879:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:3.0:1788839385.197898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839385.198091:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729319552 00000100:00100000:2.0:1788839385.198104:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729319552 00000100:00100000:2.0:1788839385.198180:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1788839385.198192:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+42:2355:x1875733729319552:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839385.198210:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839385.198239:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb17c expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.198274:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839385.198280:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839385.198344:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+41:2355:x1875733729319552:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 154us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839385.198352:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:1.0:1788839385.297551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839385.297667:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729319808 00000100:00100000:2.0:1788839385.297677:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729319808 00000100:00100000:2.0:1788839385.297742:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 154 00000100:00100000:2.0:1788839385.297753:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+41:11428:x1875733729319808:12345-192.168.201.9@tcp:101:dd.0 00010000:00010000:2.0:1788839385.297776:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839385.297793:0:8483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788839385.297822:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb152 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.297855:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839385.297860:0:8483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839385.297873:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640721 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb183 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.297985:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.297999:0:8483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.298007:0:8483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.298042:0:8483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.298110:0:8483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 41 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839385.298124:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3caff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747150464:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839385.298233:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839385.305466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839385.305605:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3caff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747150464:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839385.305638:0:8483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839385.305652:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729319936 00000100:00100000:3.0:1788839385.305659:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729319936 00010000:00010000:3.0:1788839385.305707:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 42 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839385.305750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:3.0:1788839385.305760:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+42:2357:x1875733729319936:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839385.305775:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839385.305782:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 42 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.305795:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 42 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.305817:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d636406f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb175 expref: 42 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.305833:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:3.0:1788839385.305842:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.305853:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.305879:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.305909:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839385.305957:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+41:2357:x1875733729319936:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 198us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839385.305965:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00010000:00010000:1.0:1788839385.306281:0:8483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.306290:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839385.306309:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788839385.306482:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640721 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 42 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.306499:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 41 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.306506:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:1.0:1788839385.306516:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839385.306519:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb600, rc 0) 00000100:00100000:1.0:1788839385.306560:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+41:11428:x1875733729319808:12345-192.168.201.9@tcp:101:dd.0 Request processed in 8809us (9019us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788839385.306568:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 154 00000100:00100000:0.0:1788839385.318240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839385.318415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729320192 00000100:00100000:3.0:1788839385.318428:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729320192 00000100:00100000:3.0:1788839385.318501:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 155 00000100:00100000:3.0:1788839385.318510:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+41:11428:x1875733729320192:12345-192.168.201.9@tcp:36:dd.0 00010000:00010000:3.0:1788839385.318778:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.318795:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.318807:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839385.318848:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788839385.318865:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033f2df2e reply state 00000000f3e9e462 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839385.318871:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839385.318964:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+44:11428:x1875733729320192:12345-192.168.201.9@tcp:36:dd.0 Request processed in 453us (730us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788839385.318971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 155 00000020:00080000:3.0:1788839385.318975:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788839385.324903:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.324921:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.324947:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.324954:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839385.324959:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.324967:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.324988:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839385.324991:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839385.324996:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839385.325003:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640736 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.469938:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839385.798156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839385.798544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729320320 00000100:00100000:3.0:1788839385.798555:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729320320 00000100:00100000:3.0:1788839385.798624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:3.0:1788839385.798636:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+43:11442:x1875733729320320:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:3.0:1788839385.798664:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839385.798688:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364073d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb18a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798762:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798779:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798792:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798808:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798815:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798821:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798915:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798926:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 44 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.798955:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.799013:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 44 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839385.799029:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 44 pid: 8483 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839385.799044:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10755880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747150592:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839385.799190:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb030376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839385.801362:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10755880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747150592:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839385.801394:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839385.802126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839385.802270:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729320576 00000100:00100000:3.0:1788839385.802279:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729320576 00000100:00100000:3.0:1788839385.802350:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:3.0:1788839385.802361:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+45:9954:x1875733729320576:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788839385.802761:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+46:9954:x1875733729320576:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 400us (636us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788839385.802769:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:3.0:1788839385.805933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839385.806103:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729320704 00000100:00100000:0.0:1788839385.806116:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729320704 00010000:00010000:0.0:1788839385.806159:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 46 pid: 8483 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839385.806204:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:0.0:1788839385.806214:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+46:2358:x1875733729320704:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839385.806252:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839385.806260:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 46 pid: 8483 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.806274:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 46 pid: 8483 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.806299:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640728 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb183 expref: 46 pid: 8483 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.806324:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839385.806330:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.806341:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.806350:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.806390:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839385.806454:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+45:2358:x1875733729320704:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 240us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839385.806474:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 66 00010000:00010000:1.0:1788839385.806690:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806699:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839385.806746:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788839385.806751:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839385.806780:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806793:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806803:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806810:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806816:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806834:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839385.806839:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806847:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806857:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839385.806859:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839385.806863:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806869:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806881:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.806887:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807324:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807331:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839385.807333:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807339:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807359:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb0c453300) 00010000:00010000:1.0:1788839385.807362:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839385.807365:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807370:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364074b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807412:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364073d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb18a expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807425:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb18a expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839385.807433:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:1.0:1788839385.807436:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839385.807438:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:1.0:1788839385.807506:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+44:11442:x1875733729320320:12345-192.168.201.9@tcp:101:stat.0 Request processed in 8872us (9360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839385.807514:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:3.0:1788839385.918860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839385.918983:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729320960 00000100:00100000:0.0:1788839385.918996:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729320960 00000100:00100000:0.0:1788839385.919093:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 157 00000100:00100000:0.0:1788839385.919105:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+44:11448:x1875733729320960:12345-192.168.201.9@tcp:36:truncate.0 00010000:00010000:0.0:1788839385.919219:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839385.919251:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb18a expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.919272:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839385.919278:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839385.919503:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.919518:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.919530:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839385.919584:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788839385.919611:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2a6f75d reply state 00000000b54d8dfb transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839385.919620:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839385.919728:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+46:11448:x1875733729320960:12345-192.168.201.9@tcp:36:truncate.0 Request processed in 625us (876us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788839385.919735:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 157 00000020:00080000:0.0:1788839385.919740:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788839385.926644:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.926665:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.926673:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.926696:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839385.926701:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.926710:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.926727:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839385.926731:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839385.926736:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839385.926753:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640759 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839386.252301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839386.252485:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729321088 00000100:00100000:1.0:1788839386.252498:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729321088 00000100:00100000:1.0:1788839386.252563:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 158 00000100:00100000:1.0:1788839386.252574:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+45:11462:x1875733729321088:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:1.0:1788839386.252599:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839386.252623:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640760 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb191 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252713:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252729:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252740:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252752:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252758:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252765:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252851:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252861:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252868:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839386.252914:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788839386.252918:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839386.252935:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252958:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252966:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252973:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252980:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252985:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839386.252989:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.252996:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253008:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839386.253011:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839386.253016:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253022:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640767 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253034:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253040:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253109:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253115:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839386.253182:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253191:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253199:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb05a79000) 00010000:00010000:1.0:1788839386.253202:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839386.253205:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253210:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364076e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253242:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640760 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 47 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253255:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 46 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.253262:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:1.0:1788839386.253264:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839386.253266:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9dc00, rc 0) 00000100:00100000:1.0:1788839386.253341:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+46:11462:x1875733729321088:12345-192.168.201.9@tcp:101:stat.0 Request processed in 769us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839386.253357:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 158 00000100:00100000:3.0:1788839386.404533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839386.412303:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729321344 00000100:00100000:0.0:1788839386.412322:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729321344 00000100:00100000:0.0:1788839386.412411:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 159 00000100:00100000:0.0:1788839386.412423:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+46:11472:x1875733729321344:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839386.412446:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839386.412481:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364077c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb198 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839386.412572:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788839386.413352:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364077c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb198 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.413369:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:0.0:1788839386.413386:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839386.413393:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d6364077c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb198 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.413420:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839386.413564:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+47:11472:x1875733729321344:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1142us (9040us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788839386.413571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 159 00000100:00100000:2.0:1788839386.434334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839386.435321:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729321600 00000100:00100000:3.0:1788839386.435340:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729321600 00000100:00100000:3.0:1788839386.435418:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:3.0:1788839386.435430:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de3a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+47:11472:x1875733729321600:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1788839386.435737:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de3a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+48:11472:x1875733729321600:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 309us (1411us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788839386.435746:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00010000:00010000:3.0:1788839386.493698:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839386.566245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839386.566526:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729321856 00000100:00100000:1.0:1788839386.566537:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729321856 00000100:00100000:1.0:1788839386.566597:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 160 00000100:00100000:1.0:1788839386.566607:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+48:11478:x1875733729321856:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839386.566633:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839386.566666:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364078a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb19f expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.566772:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.566787:0:8483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 49 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.566796:0:8483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.566827:0:8483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 49 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.566840:0:8483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 49 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839386.566853:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747150720:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839386.566950:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea028e6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839386.571913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839386.572522:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747150720:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839386.572555:0:8483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839386.573879:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729321984 00000100:00100000:0.0:1788839386.573893:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729321984 00010000:00010000:0.0:1788839386.573945:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 50 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839386.573995:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:0.0:1788839386.574006:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+50:2357:x1875733729321984:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839386.574021:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839386.574029:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 50 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.574042:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 50 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.574101:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640775 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb191 expref: 50 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.574119:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839386.574125:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.574148:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.574156:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.574192:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839386.574262:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+49:2357:x1875733729321984:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 258us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839386.574270:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00010000:00010000:2.0:1788839386.575545:0:8483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.575561:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839386.575585:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788839386.575783:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364078a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 50 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.575806:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 49 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.575815:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839386.575817:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839386.575821:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c400, rc 0) 00000100:00100000:2.0:1788839386.575892:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+49:11478:x1875733729321856:12345-192.168.201.9@tcp:101:bash.0 Request processed in 9286us (9659us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788839386.575901:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 160 00000100:00100000:1.0:1788839386.582593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839386.582835:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729322240 00000100:00100000:3.0:1788839386.582846:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729322240 00000100:00100000:3.0:1788839386.582911:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 161 00000100:00100000:3.0:1788839386.582921:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+49:11478:x1875733729322240:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:3.0:1788839386.583702:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839386.583724:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839386.583736:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839386.583792:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788839386.583819:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cad5cee9 reply state 000000004c00c522 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839386.583829:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839386.583987:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+52:11478:x1875733729322240:12345-192.168.201.9@tcp:36:bash.0 Request processed in 1065us (1402us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788839386.583997:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 161 00000020:00080000:3.0:1788839386.584003:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788839386.597283:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.597303:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.597311:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.597330:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839386.597336:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.597344:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.597364:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839386.597367:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839386.597395:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.597402:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d6364079f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839386.601497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839386.601917:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729322368 00000100:00100000:3.0:1788839386.601937:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729322368 00000100:00100000:3.0:1788839386.602102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00100000:3.0:1788839386.602126:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+51:11478:x1875733729322368:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1788839386.602169:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839386.602215:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d636407a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1a6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839386.602338:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839386.602357:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 52 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839386.602366:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839386.602408:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 52 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839386.602423:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 52 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839386.602458:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb10754700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747150848:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839386.602586:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb03037a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839386.629647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839386.629798:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729322496 00000100:00100000:0.0:1788839386.629813:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729322496 00010000:00010000:0.0:1788839386.629866:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 53 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839386.629926:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:0.0:1788839386.629938:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:2358:x1875733729322496:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839386.629958:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839386.629966:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 53 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.629981:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 53 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.630013:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839386.630020:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.630287:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.630297:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.630323:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839386.630409:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:2358:x1875733729322496:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 473us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839386.630419:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 68 00010000:00010000:1.0:1788839386.632678:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640791 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb19f expref: 52 pid: 8483 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839386.632713:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb10754700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747150848:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839386.632749:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.632762:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.632769:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839386.632857:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788839386.632864:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839386.632898:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.632954:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d636407a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1a6 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.632976:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1a6 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.632987:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:1.0:1788839386.632990:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839386.632994:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:1.0:1788839386.633196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+51:11478:x1875733729322368:12345-192.168.201.9@tcp:101:bash.0 Request processed in 31071us (31708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839386.633229:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00100000:3.0:1788839386.647506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839386.647642:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729322752 00000100:00100000:1.0:1788839386.647661:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729322752 00000100:00100000:1.0:1788839386.647750:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1788839386.647763:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+51:11478:x1875733729322752:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:1.0:1788839386.648197:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+52:11478:x1875733729322752:12345-192.168.201.9@tcp:35:bash.0 Request processed in 436us (707us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788839386.648205:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:3.0:1788839386.790022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839386.790210:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729323008 00000100:00100000:0.0:1788839386.790226:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729323008 00000100:00100000:0.0:1788839386.790314:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 163 00000100:00100000:0.0:1788839386.790326:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+52:11488:x1875733729323008:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839386.790361:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839386.790388:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636407b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1ad expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839386.790534:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788839386.790703:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636407b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1ad expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.790721:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:0.0:1788839386.790724:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839386.790731:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636407b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1ad expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.790766:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6200, rc 0) 00000100:00100000:0.0:1788839386.790868:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+53:11488:x1875733729323008:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 544us (862us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788839386.790876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 163 00000100:00100000:3.0:1788839386.797519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839386.797644:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729323136 00000100:00100000:2.0:1788839386.797658:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729323136 00000100:00100000:2.0:1788839386.797741:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:2.0:1788839386.797754:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+53:11488:x1875733729323136:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:2.0:1788839386.797880:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.797911:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.797925:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.797942:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.797949:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.797955:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798111:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798120:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798147:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839386.798200:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798214:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798222:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798230:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798236:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebbc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839386.798241:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798250:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798266:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839386.798269:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839386.798275:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798282:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d636407c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798299:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798313:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798318:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798324:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839386.798327:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798334:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798342:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb03866a00) 00010000:00010000:2.0:1788839386.798345:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839386.798348:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798353:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d636407c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798373:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798379:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798385:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798389:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebaa00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839386.798401:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798407:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798415:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839386.798418:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839386.798421:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.798427:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636407d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839386.798547:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+53:11488:x1875733729323136:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 793us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839386.798556:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:2.0:1788839386.802601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839386.802761:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729323392 00000100:00100000:1.0:1788839386.802775:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729323392 00000100:00100000:1.0:1788839386.802856:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:1.0:1788839386.802869:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+53:11488:x1875733729323392:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1788839386.803436:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+54:11488:x1875733729323392:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 568us (858us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788839386.803457:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:3.0:1788839386.865231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839386.865390:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729323648 00000100:00100000:0.0:1788839386.865404:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729323648 00000100:00100000:0.0:1788839386.865512:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:0.0:1788839386.865527:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+54:11491:x1875733729323648:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839386.865561:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839386.865596:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636407d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1b4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865700:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865720:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865733:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865751:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865758:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865764:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865921:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636407ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865940:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636407ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.865947:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636407ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839386.865958:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788839386.866138:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866147:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866154:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866160:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839386.866166:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866175:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866190:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839386.866194:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839386.866200:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866208:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636407de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866243:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866256:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866263:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866267:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839386.866271:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866276:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866285:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb08280300) 00010000:00010000:0.0:1788839386.866287:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839386.866290:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866295:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636407e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866356:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d636407d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1b4 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866373:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636407ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1b4 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839386.866381:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839386.866384:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839386.866394:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839386.866505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+56:11491:x1875733729323648:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 981us (1290us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788839386.866514:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:3.0:1788839386.870210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839386.873567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839386.874156:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729323904 00000100:00100000:1.0:1788839386.874172:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729323904 00000100:00100000:1.0:1788839386.874264:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:1.0:1788839386.874278:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+56:11491:x1875733729323904:12345-192.168.201.9@tcp:54:lfs.0 00000100:00100000:2.0:1788839386.874290:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729323776 00000100:00100000:2.0:1788839386.874296:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729323776 00000100:00100000:2.0:1788839386.874380:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1788839386.874389:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+57:2355:x1875733729323776:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839386.874399:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.874406:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839386.874427:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.874452:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.874584:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636407ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1b4 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839386.874718:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:2.0:1788839386.874724:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839386.875210:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+56:2355:x1875733729323776:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 820us (5017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839386.875231:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00010000:00010000:1.0:1788839386.880384:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.880410:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.880420:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.880427:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839386.880433:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.880451:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.880474:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:1.0:1788839386.880478:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839386.880483:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839386.880490:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d636407fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839386.880640:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+55:11491:x1875733729323904:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 6358us (7082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839386.880651:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:3.0:1788839386.887844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839386.890332:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729324160 00000100:00100000:1.0:1788839386.890358:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729324160 00000100:00100000:1.0:1788839386.890455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:1.0:1788839386.890493:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+55:11491:x1875733729324160:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1788839386.890837:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+56:11491:x1875733729324160:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 347us (3009us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788839386.890846:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000001:00080000:2.0:1788839387.029927:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:2.0:1788839387.030169:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:2.0:1788839387.030299:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788839387.030625:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839387.030649:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3711a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747150976:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788839387.030732:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839387.030788:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747150976 00000100:00100000:1.0:1788839387.030798:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747150976 00000100:00080000:0.0:1788839387.030858:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839387.030870:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839387.030881:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747150976:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788839387.030895:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb36fd7840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788839387.030899:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb3c8da700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb011ca0c0 00000020:00080000:2.0:1788839387.030902:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb3c8dac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb0333a400 00002000:00080000:1.0:1788839387.030912:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000020:00080000:0.0:1788839387.030939:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00002000:00010000:1.0:1788839387.030948:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f85d9, atime: 0x6a9f85d9, ctime: 0x6a9f85d9, blocks: 0xb 00010000:00010000:1.0:1788839387.030956:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.030974:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1788839387.030979:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839387.030985:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031000:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031009:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031017:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031079:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1788839387.031163:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788839387.031796:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747150976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 915us (1062us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788839387.031805:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1788839387.031837:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839387.031843:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031852:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839387.031856:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031864:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031878:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031883:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e89ae171/0x4b63896d63640801 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.031896:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839387.031897:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839387.031898:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839387.032637:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788839387.032647:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788839387.032670:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eb3711a680 x1875733747150976/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788839403 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788839387.032682:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb3711a680/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788839387.032687:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3711a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747150976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788839387.131524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.131662:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729324416 00000100:00100000:0.0:1788839387.131671:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729324416 00000100:00100000:0.0:1788839387.131776:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:0.0:1788839387.131786:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+16:11509:x1875733729324416:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:0.0:1788839387.131810:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839387.131829:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640808 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1bb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.131916:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364080f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.131928:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364080f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.131949:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364080f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839387.131958:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788839387.132218:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640808 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1bb expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.132253:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364080f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1bb expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.132262:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:0.0:1788839387.132266:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788839387.132269:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839387.132344:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11509:x1875733729324416:12345-192.168.201.9@tcp:101:cat.0 Request processed in 558us (827us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788839387.132351:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00080000:1.0:1788839387.133262:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839387.179739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839387.180722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729324544 00000100:00100000:1.0:1788839387.180746:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729324544 00000100:00100000:1.0:1788839387.180816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:1.0:1788839387.180829:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11510:x1875733729324544:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839387.180854:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839387.180878:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364081d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.180953:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.180968:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.180980:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839387.181013:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788839387.181017:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839387.181035:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.181109:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d6364081d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c2 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.181139:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c2 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.181149:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839387.181152:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839387.181156:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d600, rc 0) 00000100:00100000:1.0:1788839387.181784:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11510:x1875733729324544:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 955us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839387.181793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:2.0:1788839387.194942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839387.195107:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729324928 00000100:00100000:3.0:1788839387.195129:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729324928 00000100:00100000:3.0:1788839387.195195:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:3.0:1788839387.195207:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11510:x1875733729324928:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1788839387.195787:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11510:x1875733729324928:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 580us (854us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788839387.195796:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:3.0:1788839387.202083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839387.204403:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729325056 00000100:00100000:1.0:1788839387.204419:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729325056 00000100:00100000:1.0:1788839387.204822:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:1.0:1788839387.204835:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11510:x1875733729325056:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:1.0:1788839387.204853:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788839387.204877:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d636407ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1a6 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.204901:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364080f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1bb expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.204927:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba800/0x4b63896d636406b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb167 expref: 18 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.204941:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866200) 00010000:00010000:1.0:1788839387.204951:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839387.205026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+17:11510:x1875733729325056:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 187us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839387.205035:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1788839387.218684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.218927:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729325184 00000100:00100000:0.0:1788839387.218937:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729325184 00000100:00100000:0.0:1788839387.219005:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:0.0:1788839387.219015:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+17:11510:x1875733729325184:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:0.0:1788839387.219155:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.219179:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.219190:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839387.219589:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788839387.219691:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+17:11510:x1875733729325184:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 676us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.219699:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:2.0:1788839387.247028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839387.247156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729325312 00000100:00100000:1.0:1788839387.247176:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729325312 00000100:00100000:1.0:1788839387.247235:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 170 00000100:00100000:1.0:1788839387.247246:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+17:11512:x1875733729325312:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839387.247267:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839387.247303:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640832 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1c9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247383:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247399:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247410:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247425:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247466:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247473:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247774:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247790:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839387.247823:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788839387.247828:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839387.247845:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247867:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247875:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247882:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247888:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247895:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ca00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839387.247899:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247907:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247918:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839387.247922:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839387.247926:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640839 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247945:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247950:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247962:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247968:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839387.247970:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247977:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247985:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb05a79000) 00010000:00010000:1.0:1788839387.247987:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839387.247990:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.247995:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640840 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.248026:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c400/0x4b63896d63640832 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.248041:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.248988:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb08280b00) 00010000:00010000:1.0:1788839387.248994:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839387.248999:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c200, rc 0) 00000100:00100000:0.0:1788839387.249174:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11512:x1875733729325312:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1920us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.249184:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 170 00000040:00080000:0.0:1788839387.261370:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839387.261381:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839387.261422:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788839387.261428:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788839387.261594:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37118e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747151104:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839387.261704:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839387.264761:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37118e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747151104:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788839387.275854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.276753:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729325440 00000100:00100000:0.0:1788839387.276771:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729325440 00000100:00100000:0.0:1788839387.276849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:0.0:1788839387.276862:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729325440:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788839387.276907:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788839387.277189:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729325440:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 328us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.277197:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:2.0:1788839387.296909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839387.297046:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729325568 00000100:00100000:1.0:1788839387.297503:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729325568 00000100:00100000:0.0:1788839387.297984:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 172 00000100:00100000:0.0:1788839387.297997:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729325568:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788839387.298123:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298143:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298155:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298180:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298188:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298195:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298222:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298230:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298236:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839387.298275:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788839387.298290:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839387.298305:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298316:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298329:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298335:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298341:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.298346:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298354:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298370:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:0.0:1788839387.298373:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839387.298378:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298384:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364084e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298414:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298419:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298424:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298429:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.298450:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298456:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298464:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91eb08280300) 00010000:00010000:0.0:1788839387.298466:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839387.298479:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298485:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640855 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298502:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298516:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298522:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298527:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.298529:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298535:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298542:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb08280b00) 00010000:00010000:0.0:1788839387.298544:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839387.298563:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.298569:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d6364085c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.298669:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729325568:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 673us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.298677:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 172 00000100:00100000:2.0:1788839387.308535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.312378:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729325824 00000100:00100000:0.0:1788839387.312403:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729325824 00000100:00100000:0.0:1788839387.313043:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:0.0:1788839387.313101:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729325824:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839387.313137:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839387.313170:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640863 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1d0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313318:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313338:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313356:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839387.313368:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788839387.313520:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313528:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313556:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313563:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.313569:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313578:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313594:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb08280b00) 00010000:00010000:0.0:1788839387.313599:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839387.313604:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313611:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364086a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313689:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640863 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1d0 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313701:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:0.0:1788839387.313704:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839387.313708:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640863 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1d0 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.313720:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839387.313821:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11515:x1875733729325824:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 726us (5304us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788839387.313839:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:2.0:1788839387.323282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839387.323368:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729325952 00000100:00100000:3.0:1788839387.323381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729325952 00000100:00100000:3.0:1788839387.323465:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:3.0:1788839387.323478:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11515:x1875733729325952:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788839387.323529:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788839387.323682:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11515:x1875733729325952:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 207us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839387.323691:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:2.0:1788839387.326655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839387.327813:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729326208 00000100:00100000:3.0:1788839387.327830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729326208 00000100:00100000:2.0:1788839387.328009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:2.0:1788839387.328031:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11515:x1875733729326208:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839387.328221:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839387.328226:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788839387.328266:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c2 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.328292:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839387.328298:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839387.328316:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640878 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839387.329887:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788839387.334935:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6364087f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.334970:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6364087f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.334987:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6364087f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.337003:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640878 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1d7 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.337082:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6364087f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1d7 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.337094:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb03866a00) 00010000:00010000:2.0:1788839387.337097:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839387.337102:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb000, rc 0) 00000100:00100000:2.0:1788839387.337197:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11515:x1875733729326208:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 9170us (10557us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788839387.337208:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:2.0:1788839387.340701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839387.340853:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729326464 00000100:00100000:3.0:1788839387.340869:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729326464 00000100:00100000:3.0:1788839387.340959:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:3.0:1788839387.340973:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11515:x1875733729326464:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788839387.341292:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839387.341330:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d6364087f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1d7 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.341355:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb03866a00) 00010000:00010000:3.0:1788839387.341368:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839387.341400:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.341428:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.341449:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.342468:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.342496:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.342511:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.342822:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.342831:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.342838:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.342844:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.343220:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343232:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343250:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839387.343253:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839387.343258:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343276:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d6364088d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343293:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343299:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343304:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343309:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.343312:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343318:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343326:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3244c29d (ffff91eb08280300) 00010000:00010000:0.0:1788839387.343328:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839387.343331:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.343336:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640894 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3244c29d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.343474:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11515:x1875733729326464:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 2500us (2783us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839387.343484:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:2.0:1788839387.345450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.345535:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729326592 00000100:00100000:0.0:1788839387.345549:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729326592 00000100:00100000:0.0:1788839387.345619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 177 00000100:00100000:0.0:1788839387.345632:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11515:x1875733729326592:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839387.345654:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839387.345692:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364089b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1de expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.345738:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.345755:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.345768:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.345882:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d6364089b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.345912:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.345921:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:0.0:1788839387.345925:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788839387.345928:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:0.0:1788839387.346011:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11515:x1875733729326592:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 381us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.346018:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 177 00000100:00100000:3.0:1788839387.348799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.349112:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729326848 00000100:00100000:0.0:1788839387.349121:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729326848 00000100:00100000:0.0:1788839387.349322:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 178 00000100:00100000:0.0:1788839387.349337:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11515:x1875733729326848:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839387.349430:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.349463:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.349474:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839387.349826:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788839387.349840:0:8483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370040789218ns, next at 371040785198ns, rc = 0 00000004:00010000:0.0:1788839387.349946:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad50f5b0 reply state 00000000032438b7 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.349956:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839387.350163:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+22:11515:x1875733729326848:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 828us (1373us total) trans 4294967459 rc 0/0 00010000:00010000:3.0:1788839387.352720:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.352742:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.352751:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.352757:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839387.352763:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.352772:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.352806:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:3.0:1788839387.352809:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788839387.352816:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.352823:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839387.354457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.354942:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729326976 00000100:00100000:2.0:1788839387.354963:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729326976 00000100:00100000:2.0:1788839387.355120:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 179 00000100:00100000:2.0:1788839387.355130:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+22:11515:x1875733729326976:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839387.355169:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839387.355196:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.355269:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.355284:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.355303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:2.0:1788839387.355306:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839387.355310:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebbe00, rc 0) 00000100:00100000:2.0:1788839387.355394:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11515:x1875733729326976:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 264us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839387.355402:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 179 00000100:00100000:0.0:1788839387.355552:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 178 00000100:00100000:3.0:1788839387.364994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.365256:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729327104 00000100:00100000:0.0:1788839387.365268:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729327104 00000100:00100000:0.0:1788839387.365328:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:0.0:1788839387.365338:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729327104:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788839387.365677:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729327104:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 338us (692us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788839387.365687:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00080000:2.0:1788839387.366512:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839387.372258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.372770:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729327360 00000100:00100000:2.0:1788839387.372782:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729327360 00000100:00100000:2.0:1788839387.372862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:2.0:1788839387.372873:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+22:11515:x1875733729327360:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839387.373137:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11515:x1875733729327360:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 266us (890us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788839387.373144:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:3.0:1788839387.377678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.378287:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729327616 00000100:00100000:0.0:1788839387.378307:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729327616 00000100:00100000:0.0:1788839387.378395:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:0.0:1788839387.378408:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11515:x1875733729327616:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788839387.378586:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11515:x1875733729327616:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 181us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.378595:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:0.0:1788839387.393623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.393934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729327744 00000100:00100000:2.0:1788839387.393951:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729327744 00000100:00100000:2.0:1788839387.394097:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 181 00000100:00100000:2.0:1788839387.394129:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11515:x1875733729327744:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839387.394159:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839387.394185:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636408b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1ec expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.394282:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636408be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.394301:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636408be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.394315:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636408be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839387.394362:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839387.394388:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636408be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.394765:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d636408b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1ec expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.394789:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636408be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1ec expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.394799:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:2.0:1788839387.394802:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788839387.394807:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb600, rc 0) 00000100:00100000:2.0:1788839387.394896:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11515:x1875733729327744:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 770us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839387.394916:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 181 00000100:00100000:2.0:1788839387.398339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839387.398450:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729327872 00000100:00100000:3.0:1788839387.398465:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729327872 00000100:00100000:3.0:1788839387.398545:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:3.0:1788839387.398559:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729327872:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839387.398587:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839387.398615:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1f3 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839387.398653:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f85dc, blocks: 0x1 00010000:00010000:3.0:1788839387.398678:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1788839387.398683:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839387.398696:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.398719:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.398756:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e800, rc 0) 00000100:00100000:3.0:1788839387.398837:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729327872:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 281us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839387.398845:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:3.0:1788839387.410120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.410282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729328128 00000100:00100000:0.0:1788839387.410295:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729328128 00000100:00100000:0.0:1788839387.410369:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 182 00000100:00100000:0.0:1788839387.410381:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11515:x1875733729328128:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788839387.410549:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11515:x1875733729328128:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 170us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.410558:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 182 00000100:00100000:0.0:1788839387.416972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839387.417123:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729328256 00000100:00100000:1.0:1788839387.417143:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729328256 00000100:00100000:1.0:1788839387.417294:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1788839387.417309:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:11515:x1875733729328256:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839387.417334:0:9213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839387.417363:0:9213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb1fa expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.417403:0:9213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.417497:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839387.417503:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839387.417510:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 9 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.417556:0:9213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.417573:0:9213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 9 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839387.417589:0:9213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747151232:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839387.417718:0:9213:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea028e6900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839387.421597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.421683:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729328384 00000100:00100000:0.0:1788839387.421692:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729328384 00010000:00010000:0.0:1788839387.421731:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 10 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.421775:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:0.0:1788839387.421784:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+10:2358:x1875733729328384:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839387.421797:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839387.421819:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 10 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.421845:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 10 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.421869:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839387.421873:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839387.421997:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 10 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.422008:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 10 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.422046:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 10 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.422083:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1875733747151360:192.168.201.9@tcp:105: 00010000:00010000:1.0:1788839387.422124:0:9213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cf20bae/0x4b63896d636408c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1f3 expref: 10 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.422167:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839387.423503:0:9213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747151232:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839387.423566:0:9213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 9 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.423591:0:9213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c400, rc 0) 00000100:00100000:1.0:1788839387.423683:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+9:11515:x1875733729328256:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 6376us (6721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839387.423693:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:0.0:1788839387.424611:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1875733747151360:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839387.424637:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839387.424770:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729328384:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 2985us (3180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.424782:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:0.0:1788839387.432852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839387.433382:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729328512 00000100:00100000:1.0:1788839387.433398:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729328512 00002000:00100000:1.0:1788839387.433509:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91eb3357ca80 x1875733729328512/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:533/0 lens 504/0 e 0 to 0 dl 1788839398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839387.433523:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb3357ca80 with x1875733729328512 ext(0->8) 00002000:00010000:1.0:1788839387.433531:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb3357ca80 00000100:00100000:2.0:1788839387.434893:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:2.0:1788839387.434931:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729328512:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788839387.435783:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+10:2357:x1875733729328512:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 867us (2939us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788839387.435793:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00002000:00100000:2.0:1788839387.435805:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91eb3357ca80 x1875733729328512/t4294967314(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:533/0 lens 504/448 e 0 to 0 dl 1788839398 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839387.435816:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb3357ca80 with x1875733729328512 ext(0->8) 00002000:00010000:2.0:1788839387.435823:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb3357ca80 00000100:00100000:2.0:1788839387.446728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.446991:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729328640 00000100:00100000:0.0:1788839387.447006:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729328640 00000100:00100000:0.0:1788839387.447138:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 183 00000100:00100000:0.0:1788839387.447152:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11515:x1875733729328640:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1788839387.525564:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788839387.537728:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788839387.537749:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788839387.537783:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788839387.537798:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788839387.537969:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788839387.537980:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788839387.538019:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747151488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788839387.538346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839387.538749:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729328640:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 91595us (92028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839387.538763:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 183 00000100:00100000:3.0:1788839387.543766:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747151488 00000100:00100000:3.0:1788839387.543797:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747151488 00000100:00100000:3.0:1788839387.543908:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839387.543924:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747151488:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788839387.544011:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788839387.544280:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788839387.544285:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788839388 00002000:00010000:3.0:1788839387.544288:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788839387.544290:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788839388 -> 1788839388 00002000:00010000:3.0:1788839387.544293:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788839387.544554:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747151488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 633us (6207us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788839387.544564:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788839387.544625:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb3cafd180/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788839387.544633:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747151488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788839387.544913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.544969:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729328768 00000100:00100000:2.0:1788839387.544976:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729328768 00000100:00100000:2.0:1788839387.545030:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:2.0:1788839387.545040:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+10:2356:x1875733729328768:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788839387.560741:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1788839387.560781:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788839387.627434:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729328768:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 82368us (82499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839387.627452:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000001:00080000:1.0:1788839387.627546:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788839387.630526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.630638:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729329024 00000100:00100000:0.0:1788839387.630652:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729329024 00000100:00100000:0.0:1788839387.630781:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 184 00000100:00100000:0.0:1788839387.630794:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729329024:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839387.630875:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839387.630917:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d636408be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1ec expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.630943:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:0.0:1788839387.630949:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839387.630987:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.631006:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.631017:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839387.631407:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e62c0d0 reply state 000000007b63a07b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.631419:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839387.631590:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11515:x1875733729329024:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 796us (1079us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788839387.631637:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 184 00010000:00010000:2.0:1788839387.634490:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.634518:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.634527:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.634535:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839387.634542:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.634552:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.634578:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:2.0:1788839387.634583:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839387.634590:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.634598:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.634802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839387.634894:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729329152 00000100:00100000:3.0:1788839387.634906:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729329152 00000100:00100000:3.0:1788839387.634975:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:3.0:1788839387.634996:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2357:x1875733729329152:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788839387.635352:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788839387.635356:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788839388 -> 1788839387 00002000:00010000:3.0:1788839387.635358:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788839385 00002000:00010000:3.0:1788839387.635360:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788839388 -> 1788839387 00002000:00010000:3.0:1788839387.635361:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788839387.635459:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729329152:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 465us (661us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788839387.635472:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:0.0:1788839387.641953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.642005:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729329408 00000100:00100000:2.0:1788839387.642031:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729329408 00000100:00100000:2.0:1788839387.642145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00100000:2.0:1788839387.642158:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+18:11515:x1875733729329408:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788839387.642274:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.642298:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.642310:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.642360:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.642377:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 18 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839387.642397:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747151616:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839387.642762:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788839387.645145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.645323:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747151616:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839387.645360:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839387.645452:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729329536 00000100:00100000:3.0:1788839387.645471:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729329536 00010000:00010000:3.0:1788839387.645533:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 19 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839387.645575:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:3.0:1788839387.645584:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:2358:x1875733729329536:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839387.645610:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839387.645618:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 19 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.645629:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 19 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.645655:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636408a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1de expref: 19 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.645693:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:3.0:1788839387.645716:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.645725:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.645732:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.645752:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839387.645818:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+18:2358:x1875733729329536:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 235us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839387.645828:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00010000:00010000:2.0:1788839387.646046:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646093:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646139:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646146:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646154:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646161:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839387.646166:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646175:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646187:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:2.0:1788839387.646190:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788839387.646195:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.646202:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839387.646272:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+17:11515:x1875733729329408:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 4117us (4335us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788839387.646281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00100000:1.0:1788839387.648297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.648477:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729329664 00000100:00100000:0.0:1788839387.648488:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729329664 00000100:00100000:0.0:1788839387.648570:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:0.0:1788839387.648582:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2356:x1875733729329664:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788839387.648641:0:9213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.648670:0:9213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 8 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.648679:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839387.648683:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839387.648688:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.648728:0:9213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 8 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.648739:0:9213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 8 pid: 9213 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.648755:0:9213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747151744:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839387.648971:0:9213:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839387.651506:0:9213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747151744:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839387.651550:0:9213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839387.651837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.651883:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729329792 00000100:00100000:2.0:1788839387.651894:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729329792 00010000:00010000:2.0:1788839387.651946:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 9 pid: 9213 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839387.651990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:2.0:1788839387.651999:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2357:x1875733729329792:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839387.652019:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839387.652090:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 9 pid: 9213 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.652102:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 9 pid: 9213 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.652126:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e89ae171/0x4b63896d636408cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1fa expref: 9 pid: 9213 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.652141:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839387.652145:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839387.652150:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.652158:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.652178:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839387.652239:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729329792:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 240us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839387.652266:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 71 00010000:00010000:0.0:1788839387.652371:0:9213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652381:0:9213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652414:0:9213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652423:0:9213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652443:0:9213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652452:0:9213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839387.652456:0:9213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652466:0:9213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652493:0:9213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.652501:0:9213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d636408e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.652571:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729329664:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 3991us (4285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.652581:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:1.0:1788839387.654259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.654309:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729330048 00000100:00100000:0.0:1788839387.654321:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729330048 00000100:00100000:0.0:1788839387.654376:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 186 00000100:00100000:0.0:1788839387.654389:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+17:11515:x1875733729330048:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788839387.654510:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.654531:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.654544:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.654816:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.654830:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.654863:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.654922:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.654940:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 18 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.654960:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747151872:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839387.655108:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014840 going to sleep for 11 seconds 00000100:00100000:1.0:1788839387.657751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839387.657852:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729330176 00000100:00100000:3.0:1788839387.657865:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729330176 00010000:00010000:3.0:1788839387.657925:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 19 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839387.657981:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:3.0:1788839387.658034:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+19:2358:x1875733729330176:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839387.658092:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839387.658102:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 19 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.658118:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 19 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.658150:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:3.0:1788839387.658158:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.658185:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.658194:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839387.658222:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839387.658289:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+19:2358:x1875733729330176:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 297us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839387.658297:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 72 00010000:00010000:0.0:1788839387.658978:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d636408b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1e5 expref: 18 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.659003:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747151872:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839387.659035:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.659787:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.659799:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839387.660271:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788839387.660492:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788839387.660545:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788839387.660668:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40ade300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747152000:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839387.660769:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839387.660888:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea028e6900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839387.660953:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747152000 00000100:00100000:3.0:1788839387.660962:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747152000 00000100:00100000:3.0:1788839387.661338:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839387.661351:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875733747152000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788839387.661510:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875733747152000:12345-0@lo:1000:mdt00_000.0 Request processed in 161us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839387.661517:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839387.664594:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788839387.664613:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb3cafd180, transno 4294967315 00000100:00100000:0.0:1788839387.664652:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40ade300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747152000:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788839387.665361:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788839387.665503:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747152128:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788839387.665602:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839387.665928:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839387.669510:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747152128 00000100:00100000:2.0:1788839387.669539:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747152128 00000100:00100000:2.0:1788839387.669643:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839387.669657:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875733747152128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788839387.670091:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875733747152128:12345-0@lo:1000:mdt00_000.0 Request processed in 436us (4488us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788839387.670102:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839387.670149:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747152128:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788839387.670238:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670254:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670263:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670269:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.670275:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670284:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670305:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb08280d00) 00010000:00010000:0.0:1788839387.670309:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839387.670315:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670321:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636408ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670379:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670386:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670393:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670408:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839387.670411:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670418:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670440:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb08280b00) 00010000:00010000:0.0:1788839387.670443:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839387.670448:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670454:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d6364082b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670485:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670504:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670515:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670562:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.670581:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 21 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.670604:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747152256:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839387.670765:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb062513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839387.675381:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747152256:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839387.675438:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839387.675570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839387.675628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729330304 00000100:00100000:0.0:1788839387.675636:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729330304 00010000:00010000:0.0:1788839387.675676:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 22 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839387.675714:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:0.0:1788839387.675726:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+22:2358:x1875733729330304:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839387.675747:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839387.675754:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 22 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.675765:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 22 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.675791:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb1c9 expref: 22 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.675811:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb08280b00) 00010000:00010000:0.0:1788839387.675817:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.675828:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.675837:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839387.675888:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839387.675922:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.675930:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.675943:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.675952:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.675959:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.675966:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00000100:00100000:0.0:1788839387.675968:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+21:2358:x1875733729330304:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 244us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839387.675977:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 73 00010000:00010000:2.0:1788839387.675978:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.675987:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.675996:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb08280b00) 00010000:00010000:2.0:1788839387.676000:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839387.676004:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636408f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676042:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676090:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676097:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676103:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839387.676107:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676114:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676121:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb08280b00) 00010000:00010000:2.0:1788839387.676124:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839387.676134:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.676140:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636408e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839387.676470:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11515:x1875733729330048:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 22083us (22218us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788839387.676483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 186 00000020:00080000:2.0:1788839387.676488:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788839387.676656:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839387.676661:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839387.677086:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788839387.677104:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788839387.681126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839387.682558:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729330560 00000100:00100000:2.0:1788839387.682583:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729330560 00000100:00100000:2.0:1788839387.682663:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1788839387.682675:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11515:x1875733729330560:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788839387.683586:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788839387.683712:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788839387.683772:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.683794:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.683810:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.683821:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.683829:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.683836:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839387.683874:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839387.683900:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839387.683910:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.683918:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839387.683923:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.683931:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.683948:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eb03866100) 00010000:00010000:1.0:1788839387.683951:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788839387.683957:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.683962:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d636408fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839387.683982:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839387.683983:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839387.683985:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839387.684018:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+22:11515:x1875733729330560:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1340us (2904us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788839387.684028:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000020:00080000:2.0:1788839387.684034:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788839388.222943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839388.223014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839388.223089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839388.223118:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729330688 00000100:00100000:2.0:1788839388.223132:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729330688 00000100:00100000:2.0:1788839388.223198:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 300 00000100:00100000:2.0:1788839388.223209:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729330688:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839388.223317:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729330688:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.223325:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 300 00000100:00100000:0.0:1788839388.223599:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729330816 00000100:00100000:0.0:1788839388.223605:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729330816 00000100:00100000:0.0:1788839388.223668:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:0.0:1788839388.223677:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729330816:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839388.223726:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729330816:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 50us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839388.223733:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:0.0:1788839388.223756:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729330944 00000100:00100000:0.0:1788839388.223759:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729330944 00000100:00080000:2.0:1788839388.223905:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839388.224021:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:0.0:1788839388.224030:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729330944:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839388.224087:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729330944:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 59us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839388.224094:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00080000:2.0:1788839388.224264:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788839388.393656:0:12512:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839388.393666:0:12512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839388.393705:0:12512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788839388.393720:0:12512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839388.482981:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747152640:0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.483115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839388.483205:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839388.483213:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747152768:0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.483247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839388.483294:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747152768 00000100:00100000:2.0:1788839388.483304:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747152768 00000100:00100000:2.0:1788839388.483372:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788839388.483386:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747152768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.483466:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747152768:12345-0@lo:400:kworker.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.483489:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788839388.483714:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747152768:0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.484319:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747152512:0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.484385:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839388.484474:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747153024:0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.484508:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839388.484554:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788839388.484561:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747152384:0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.484616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839388.484654:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747152896:0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.484677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839388.486921:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747153024 00000100:00100000:0.0:1788839388.486945:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747153024 00000100:00100000:0.0:1788839388.487020:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788839388.487034:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747153024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.487171:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875733747153024:12345-0@lo:400:kworker.0 Request processed in 138us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839388.487180:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788839388.487227:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747152384 00000100:00100000:0.0:1788839388.487233:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747152384 00000100:00100000:0.0:1788839388.487270:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788839388.487278:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747152384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.487323:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3314:x1875733747152384:12345-0@lo:400:kworker.0 Request processed in 45us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839388.487329:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788839388.487813:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2841848a-c637-485f-b8f2-edd7dddc336d:3314:1875733747152384:0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.487838:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747153024:0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.491241:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747152640 00000100:00100000:2.0:1788839388.491262:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747152640 00000100:00080000:2.0:1788839388.491856:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839388.492631:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747152512 00000100:00100000:2.0:1788839388.492643:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747152512 00000100:00100000:2.0:1788839388.492671:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747152896 00000100:00100000:2.0:1788839388.492675:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747152896 00000100:00080000:2.0:1788839388.492696:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839388.492725:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788839388.492737:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747152640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.493130:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747152640:12345-0@lo:400:kworker.0 Request processed in 394us (10014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.493140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788839388.493202:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747152640:0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.493246:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788839388.493255:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747152512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.493292:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747152512:12345-0@lo:400:kworker.0 Request processed in 40us (8908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.493298:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788839388.493310:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788839388.493317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747152896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839388.493347:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747152896:12345-0@lo:400:kworker.0 Request processed in 31us (8669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.493353:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788839388.493689:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747152896:0@lo:400:kworker.0 00000100:00100000:0.0:1788839388.493704:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747152512:0@lo:400:kworker.0 00010000:00010000:3.0:1788839388.541206:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839388.564762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839388.564882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729331200 00000100:00100000:2.0:1788839388.564898:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729331200 00000100:00100000:2.0:1788839388.564980:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 187 00000100:00100000:2.0:1788839388.564994:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+22:11533:x1875733729331200:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839388.565042:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839388.565113:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640904 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb201 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.565249:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364090b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.565267:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364090b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.565282:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364090b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839388.565294:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788839388.565497:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb201 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.565525:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364090b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb201 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.565668:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839388.565674:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839388.565679:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba200, rc 0) 00000100:00100000:2.0:1788839388.565772:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11533:x1875733729331200:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 780us (1026us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788839388.565797:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 187 00000100:00100000:1.0:1788839388.594263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839388.597299:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729331328 00000100:00100000:0.0:1788839388.597322:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729331328 00000100:00100000:0.0:1788839388.597472:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 188 00000100:00100000:0.0:1788839388.597486:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11533:x1875733729331328:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:1.0:1788839388.605573:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.605615:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.605633:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.605662:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.605670:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.605677:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606026:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606035:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606042:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839388.606139:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606157:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606164:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606172:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606179:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839388.606183:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606192:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606210:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839388.606213:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839388.606220:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606227:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640919 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606242:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606249:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606262:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606267:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839388.606270:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606277:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606285:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb05a79d00) 00010000:00010000:1.0:1788839388.606288:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839388.606291:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606297:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606317:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606324:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606330:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606336:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ca00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839388.606339:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606356:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606381:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:1.0:1788839388.606384:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839388.606387:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.606393:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839388.606715:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11533:x1875733729331328:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 9225us (12465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839388.606729:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 188 00000100:00100000:2.0:1788839388.687645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839388.691663:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729331584 00000100:00100000:3.0:1788839388.691689:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729331584 00000100:00100000:3.0:1788839388.691803:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 189 00000100:00100000:3.0:1788839388.691816:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11536:x1875733729331584:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839388.691844:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839388.691888:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d6364092e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb208 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.691996:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692017:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692031:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692067:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692077:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692083:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692490:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692500:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692508:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839388.692520:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788839388.692653:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692672:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692679:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692686:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839388.692692:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692701:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692718:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:3.0:1788839388.692721:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839388.692729:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692735:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640935 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692749:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692755:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692761:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692765:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839388.692776:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692783:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692791:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb0c453300) 00010000:00010000:3.0:1788839388.692793:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839388.692796:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692802:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d6364093c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692857:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d6364092e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692873:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.692881:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:3.0:1788839388.692884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839388.692886:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e000, rc 0) 00000100:00100000:3.0:1788839388.692983:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+26:11536:x1875733729331584:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1169us (5353us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788839388.692992:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 189 00000100:00100000:0.0:1788839388.704172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839388.704343:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729331712 00000100:00100000:1.0:1788839388.704359:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729331712 00000100:00100000:1.0:1788839388.704470:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 190 00000100:00100000:1.0:1788839388.704483:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+26:11536:x1875733729331712:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:1.0:1788839388.704586:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704609:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704623:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704659:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704690:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704698:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704704:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839388.704710:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704720:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704737:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:1.0:1788839388.704742:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839388.704749:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.704756:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640951 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839388.704887:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+26:11536:x1875733729331712:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 405us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839388.704896:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 190 00000100:00100000:1.0:1788839388.709151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839388.709263:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729331968 00000100:00100000:2.0:1788839388.709278:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729331968 00000100:00100000:2.0:1788839388.709356:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1788839388.709383:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+26:11536:x1875733729331968:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839388.709755:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+27:11536:x1875733729331968:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 387us (618us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788839388.709764:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:3.0:1788839388.791384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839388.793191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729332224 00000100:00100000:0.0:1788839388.793219:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729332224 00000100:00100000:0.0:1788839388.793314:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 191 00000100:00100000:0.0:1788839388.793327:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+27:11070:x1875733729332224:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839388.793363:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839388.794045:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640958 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb20f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.794274:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.794298:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.794310:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.794364:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.794387:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 28 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839388.794422:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3c8c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747153152:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839388.794581:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839388.803228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839388.803496:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3c8c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747153152:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839388.803550:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839388.803669:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729332352 00000100:00100000:3.0:1788839388.803682:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729332352 00010000:00010000:3.0:1788839388.803748:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 29 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839388.803841:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:3.0:1788839388.803854:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+29:2358:x1875733729332352:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839388.803879:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839388.803902:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 29 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.803917:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 29 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.803954:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb208 expref: 29 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.803980:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:3.0:1788839388.803988:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.804001:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839388.804011:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.804292:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.804311:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839388.804339:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788839388.804586:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640958 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.804607:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.804616:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:1.0:1788839388.804619:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839388.804621:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:1.0:1788839388.804721:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+29:11070:x1875733729332224:12345-192.168.201.9@tcp:101:bash.0 Request processed in 11395us (13350us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788839388.804730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 191 00010000:00010000:3.0:1788839388.804942:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839388.804973:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+28:2358:x1875733729332352:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 1120us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839388.804981:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:1.0:1788839388.812709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839388.812825:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729332608 00000100:00100000:0.0:1788839388.812841:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729332608 00000100:00100000:0.0:1788839388.812923:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 192 00000100:00100000:0.0:1788839388.812939:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+28:11070:x1875733729332608:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:1.0:1788839388.813980:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.814010:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839388.814023:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839388.814151:0:8483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788839388.814188:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070bb756e reply state 00000000f1f14403 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839388.814223:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788839388.814290:0:8483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788839388.816302:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11070:x1875733729332608:12345-192.168.201.9@tcp:36:bash.0 Request processed in 3347us (3589us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788839388.816320:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 192 00000020:00080000:1.0:1788839388.816332:0:8483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788839388.822420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:0.0:1788839388.822492:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.822511:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.822520:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.822528:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839388.822535:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.822545:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.822570:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:0.0:1788839388.822573:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839388.822580:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839388.822588:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d6364096d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839388.822692:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729332736 00000100:00100000:2.0:1788839388.822705:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729332736 00000100:00100000:2.0:1788839388.822778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 193 00000100:00100000:2.0:1788839388.822792:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+31:11070:x1875733729332736:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839388.822824:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839388.822850:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640974 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb216 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.822946:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640974 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb216 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.822964:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640974 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb216 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.822989:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:2.0:1788839388.822993:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839388.822996:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebbc00, rc 0) 00000100:00100000:2.0:1788839388.823141:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11070:x1875733729332736:12345-192.168.201.9@tcp:101:bash.0 Request processed in 352us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.823149:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 193 00000100:00100000:0.0:1788839388.829292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839388.829390:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729332864 00000100:00100000:2.0:1788839388.829413:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729332864 00000100:00100000:2.0:1788839388.829494:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:2.0:1788839388.829507:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:11070:x1875733729332864:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839388.829535:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839388.829567:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb21d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839388.829667:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f85db, atime: 0x6a9f85d9, ctime: 0x6a9f85db, blocks: 0xb 00010000:00010000:2.0:1788839388.829699:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1788839388.829704:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839388.829711:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.829728:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.829741:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba800, rc 0) 00000100:00100000:2.0:1788839388.829831:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+8:11070:x1875733729332864:12345-192.168.201.9@tcp:101:bash.0 Request processed in 327us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.829839:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:1.0:1788839388.833880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839388.837139:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729332992 00000100:00100000:0.0:1788839388.837196:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729332992 00002000:00010000:1.0:1788839388.837332:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788839388.837340:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb36f18380 with x1875733729332992 ext(0->18446744073709551615) 00002000:00010000:1.0:1788839388.837449:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb36f18380. 00000100:00100000:1.0:1788839388.837697:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:1.0:1788839388.837710:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729332992:12345-192.168.201.9@tcp:10:bash.0 00002000:00010000:1.0:1788839388.838162:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788839388.838167:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788839387 -> 1788839389 00002000:00010000:1.0:1788839388.838170:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788839385 -> 1788839385 00002000:00010000:1.0:1788839388.838172:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788839387 -> 1788839389 00002000:00010000:1.0:1788839388.838174:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788839388.838288:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729332992:12345-192.168.201.9@tcp:10:bash.0 Request processed in 579us (4426us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788839388.838298:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00002000:00010000:1.0:1788839388.838305:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788839388.838308:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb36f18380 with x1875733729332992 ext(0->18446744073709551615) 00002000:00010000:1.0:1788839388.838313:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb36f18380. 00000100:00100000:3.0:1788839388.952880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839388.953022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729333120 00000100:00100000:2.0:1788839388.953033:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729333120 00000100:00100000:2.0:1788839388.953369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 194 00000100:00100000:2.0:1788839388.953398:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11550:x1875733729333120:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:2.0:1788839388.953494:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.953512:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.953524:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.953538:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.953546:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.953880:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954382:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954512:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954521:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839388.954637:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954650:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954665:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954671:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954677:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839388.954681:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954689:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954702:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839388.954705:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839388.954710:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954717:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640982 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954737:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954743:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954749:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954754:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839388.954763:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954769:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954778:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb03866800) 00010000:00010000:2.0:1788839388.954781:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839388.954783:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954789:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640989 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954805:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954811:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954816:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954820:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebaa00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839388.954823:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954829:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954836:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:2.0:1788839388.954838:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839388.954848:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839388.954853:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640990 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839388.955238:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11550:x1875733729333120:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 1855us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839388.955247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 194 00000100:00100000:2.0:1788839388.989517:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747153280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839388.989638:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839388.989811:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747153280 00000100:00100000:3.0:1788839388.989824:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747153280 00000100:00100000:3.0:1788839388.989911:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788839388.989924:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747153280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839388.989977:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839388.999090:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875733747153280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9126us (9411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839388.999112:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788839389.005858:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747153280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839389.016341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839389.018320:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729333376 00000100:00100000:1.0:1788839389.018347:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729333376 00000100:00100000:1.0:1788839389.018521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 195 00000100:00100000:1.0:1788839389.018539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11553:x1875733729333376:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839389.018568:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839389.018603:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d63640997 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb224 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.018712:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.018733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.019160:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.019187:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.019198:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.019205:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021286:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d636409ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021317:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d636409ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021332:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d636409ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839389.021371:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788839389.021547:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021556:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021564:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021570:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839389.021576:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021585:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021601:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839389.021605:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839389.021611:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021619:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d6364099e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021638:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021645:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021661:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021666:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839389.021669:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021676:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021685:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb05a79000) 00010000:00010000:1.0:1788839389.021687:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839389.021690:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.021696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d636409a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788839389.022218:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788839389.024524:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d63640997 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb224 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.024567:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d636409ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb224 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.024581:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:1.0:1788839389.024585:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788839389.024590:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9da00, rc 0) 00000100:00100000:1.0:1788839389.024712:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+34:11553:x1875733729333376:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 6175us (8384us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788839389.024821:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 195 00000100:00100000:3.0:1788839389.034243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839389.034355:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729333504 00000100:00100000:1.0:1788839389.034375:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729333504 00000100:00100000:1.0:1788839389.034486:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:1.0:1788839389.034745:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+34:11553:x1875733729333504:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:1.0:1788839389.035428:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.035453:0:8483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.035464:0:8483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.035523:0:8483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.039592:0:8483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 34 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839389.039623:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb36f1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747153408:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839389.039867:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ea028e6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839389.047396:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb36f1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8483:1875733747153408:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839389.047452:0:8483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839389.057666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839389.057782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729333760 00000100:00100000:2.0:1788839389.057802:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729333760 00000100:00100000:2.0:1788839389.057894:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:2.0:1788839389.057907:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+35:5594:x1875733729333760:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788839389.058522:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+36:5594:x1875733729333760:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 614us (860us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788839389.058533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:3.0:1788839389.072628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839389.073173:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729333888 00000100:00100000:2.0:1788839389.073192:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729333888 00010000:00010000:2.0:1788839389.073257:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 36 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839389.073320:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:2.0:1788839389.073332:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fda850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+36:2356:x1875733729333888:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839389.073382:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839389.073391:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 36 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.073418:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 36 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.073449:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d6364095f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb20f expref: 36 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.073473:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:2.0:1788839389.073480:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.073491:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.074905:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.075039:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839389.075322:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fda850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:2356:x1875733729333888:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 1983us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839389.075336:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 75 00010000:00010000:0.0:1788839389.090219:0:8483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090245:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090302:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090310:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090319:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090326:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9de00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.090332:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090341:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090368:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:0.0:1788839389.090372:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839389.090378:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.090430:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9de00/0x4b63896d636409ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839389.090655:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+34:11553:x1875733729333504:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 56150us (56413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839389.090670:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:3.0:1788839389.099326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839389.099832:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729334144 00000100:00100000:2.0:1788839389.099853:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729334144 00000100:00100000:2.0:1788839389.099941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:2.0:1788839389.099955:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+34:11553:x1875733729334144:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839389.100409:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+35:11553:x1875733729334144:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 445us (1083us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788839389.100419:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1788839389.264548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.264704:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729334400 00000100:00100000:0.0:1788839389.264720:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729334400 00000100:00100000:0.0:1788839389.264834:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 197 00000100:00100000:0.0:1788839389.264848:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+35:11564:x1875733729334400:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:0.0:1788839389.264885:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839389.264919:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636409c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb22b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265032:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265131:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265148:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265168:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265174:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265201:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265606:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636409d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265617:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636409d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265626:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636409d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839389.265636:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788839389.265752:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265759:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265764:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265768:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.265772:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265778:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265790:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839389.265792:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839389.265803:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265808:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d636409c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265820:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265824:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265828:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265831:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.265832:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265835:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265839:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb08280d00) 00010000:00010000:0.0:1788839389.265840:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839389.265842:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265845:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d636409cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265889:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d636409c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb22b expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265929:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636409d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb22b expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.265936:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:0.0:1788839389.265937:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839389.265939:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6c00, rc 0) 00000100:00100000:0.0:1788839389.266025:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+37:11564:x1875733729334400:12345-192.168.201.9@tcp:101:cat.0 Request processed in 1181us (1496us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788839389.266032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 197 00000100:00100000:1.0:1788839389.279300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839389.279425:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729334656 00000100:00100000:2.0:1788839389.279444:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729334656 00000100:00100000:2.0:1788839389.279677:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:2.0:1788839389.279691:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+37:11564:x1875733729334656:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:2.0:1788839389.280110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+38:11564:x1875733729334656:12345-192.168.201.9@tcp:35:cat.0 Request processed in 420us (818us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788839389.280132:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:3.0:1788839389.340451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839389.340666:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729334912 00000100:00100000:2.0:1788839389.340681:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729334912 00000100:00100000:2.0:1788839389.340775:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 198 00000100:00100000:2.0:1788839389.340789:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+38:11565:x1875733729334912:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:2.0:1788839389.340885:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788839389.340924:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d636409d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb22b expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341131:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d636409ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb224 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341145:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640974 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb216 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341159:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb0c453b00) 00010000:00010000:2.0:1788839389.341174:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839389.341221:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341236:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341246:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341262:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341269:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341276:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341696:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341707:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.341714:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839389.343299:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788839389.343319:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372034267952ns, next at 373034262989ns, rc = 0 00010000:00010000:2.0:1788839389.343435:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343455:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343481:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343493:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343501:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343520:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343545:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839389.343576:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343582:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343589:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343595:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839389.343600:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343610:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343628:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866900) 00010000:00010000:2.0:1788839389.343632:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788839389.343645:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343653:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d636409f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343685:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343692:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343698:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343703:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebaa00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839389.343706:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343714:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343722:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839389.343725:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839389.343729:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.343735:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d636409e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839389.343747:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000498d437c reply state 00000000d8c09c35 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839389.343768:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788839389.345127:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839389.345146:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.345163:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebba00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839389.345169:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.345182:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.345209:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eb03866900) 00010000:00010000:0.0:1788839389.345215:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788839389.345221:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.345228:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebba00/0x4b63896d636409f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839389.345572:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+37:11565:x1875733729334912:12345-192.168.201.9@tcp:36:rm.0 Request processed in 4777us (5130us total) trans 4294967481 rc 0/0 00010000:00010000:0.0:1788839389.345580:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839389.345586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 198 00010000:00010000:0.0:1788839389.345600:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839389.345603:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839389.368470:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.368496:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.368504:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.368509:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839389.368513:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.368520:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.368541:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb03866800) 00010000:00010000:2.0:1788839389.368544:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839389.368548:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.368553:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d636409eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839389.429422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.429544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729335168 00000100:00100000:0.0:1788839389.429555:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729335168 00000100:00100000:0.0:1788839389.429623:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 199 00000100:00100000:0.0:1788839389.429635:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+36:11571:x1875733729335168:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839389.429662:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839389.429688:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb232 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.429818:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.429834:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.429845:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.429860:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.429867:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.429874:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839389.430543:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788839389.430739:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430763:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430772:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430812:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430819:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430826:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430831:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.430835:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430843:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430855:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839389.430858:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839389.430863:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430870:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839389.430882:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000aa3181a reply state 0000000043e49d20 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839389.430899:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788839389.430932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430948:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.430955:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb08280300) 00010000:00010000:0.0:1788839389.430957:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839389.430959:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6200, rc 0) 00000100:00100000:0.0:1788839389.431095:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+39:11571:x1875733729335168:12345-192.168.201.9@tcp:101:bash.0 Request processed in 1415us (1638us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788839389.431104:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 199 00010000:00010000:0.0:1788839389.434256:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.434279:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.434288:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.434293:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.434299:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.434308:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.434355:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb08280d00) 00010000:00010000:0.0:1788839389.434360:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839389.434368:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.434375:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839389.436947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.437150:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729335296 00000100:00100000:0.0:1788839389.437163:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729335296 00000100:00100000:0.0:1788839389.437243:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:0.0:1788839389.437255:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729335296:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839389.437277:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839389.437299:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb239 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839389.437328:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839389.437348:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788839389.437352:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839389.437361:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.437390:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.437414:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839389.437490:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2357:x1875733729335296:12345-192.168.201.9@tcp:101:bash.0 Request processed in 238us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839389.437512:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:1.0:1788839389.445273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839389.451891:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729335424 00000100:00100000:2.0:1788839389.451909:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729335424 00000100:00100000:2.0:1788839389.452021:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:2.0:1788839389.452033:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:11571:x1875733729335424:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839389.452087:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839389.452112:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb240 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.452166:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.452178:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839389.452184:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839389.452190:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.452703:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.452720:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 7 pid: 6698 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839389.452735:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875733747153536:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839389.452859:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839389.456717:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875733747153536:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839389.456763:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.456812:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb200, rc 0) 00000100:00100000:2.0:1788839389.456882:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:11571:x1875733729335424:12345-192.168.201.9@tcp:101:bash.0 Request processed in 4850us (11846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839389.456891:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:3.0:1788839389.459389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.459501:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729335552 00000100:00100000:0.0:1788839389.459510:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729335552 00010000:00010000:0.0:1788839389.459558:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 7 pid: 6698 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839389.459602:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:0.0:1788839389.459612:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729335552:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839389.459628:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839389.459653:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 7 pid: 6698 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.459668:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 7 pid: 6698 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.459691:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba4fdee/0x4b63896d63640a23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb239 expref: 7 pid: 6698 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.459711:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839389.459715:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839389.459724:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.459734:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.459806:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839389.459822:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cafdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1875733747153664:192.168.201.9@tcp:105: 00000100:00100000:0.0:1788839389.459909:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839389.464778:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cafdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1875733747153664:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839389.464814:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839389.464930:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2358:x1875733729335552:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 5317us (5558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839389.464941:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:1.0:1788839389.471573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.472024:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729335808 00000100:00100000:0.0:1788839389.472036:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729335808 00000100:00100000:0.0:1788839389.472133:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:0.0:1788839389.472144:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+38:11571:x1875733729335808:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:0.0:1788839389.472549:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+39:11571:x1875733729335808:12345-192.168.201.9@tcp:35:bash.0 Request processed in 406us (986us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788839389.472559:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:0.0:1788839389.501340:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747153792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839389.501447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839389.501869:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747153792 00000100:00100000:1.0:1788839389.501877:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747153792 00000100:00100000:1.0:1788839389.501997:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839389.502008:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747153792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839389.502083:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839389.502146:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747153792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839389.502153:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788839389.502280:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747153792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788839389.502746:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839389.565283:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839389.716381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.724620:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729335936 00000100:00100000:0.0:1788839389.724637:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729335936 00000100:00100000:0.0:1788839389.724725:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 200 00000100:00100000:0.0:1788839389.724752:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+39:11587:x1875733729335936:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839389.724780:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839389.724801:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb247 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.724881:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.724898:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.724908:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839389.724942:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788839389.724946:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839389.724963:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.725007:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb247 expref: 41 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.725026:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb247 expref: 40 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.725036:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839389.725039:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839389.725043:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7800, rc 0) 00000100:00100000:0.0:1788839389.725168:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+40:11587:x1875733729335936:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 418us (8796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839389.725185:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 200 00000100:00100000:1.0:1788839389.735916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.736093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729336192 00000100:00100000:0.0:1788839389.736104:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729336192 00000100:00100000:0.0:1788839389.736159:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 201 00000100:00100000:0.0:1788839389.736169:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+40:11587:x1875733729336192:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839389.736189:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839389.736211:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb24e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.736314:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.736328:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.736338:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839389.736348:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788839389.736679:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb24e expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.736700:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb24e expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.736708:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb08280300) 00010000:00010000:0.0:1788839389.736712:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839389.736715:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839389.736800:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+42:11587:x1875733729336192:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 632us (891us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788839389.736808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 201 00000100:00100000:1.0:1788839389.743437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839389.743496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.743637:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729336448 00000100:00100000:0.0:1788839389.743653:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729336448 00000100:00100000:0.0:1788839389.743728:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:0.0:1788839389.743741:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+42:11587:x1875733729336448:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839389.743769:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839389.743793:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb255 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.743907:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.743924:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.743935:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839389.743949:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788839389.744122:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640a54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb255 expref: 45 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.744141:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb255 expref: 44 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.744150:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb08280300) 00010000:00010000:0.0:1788839389.744153:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788839389.744172:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:0.0:1788839389.744226:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+44:11587:x1875733729336448:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 487us (798us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788839389.744234:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:3.0:1788839389.744362:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729336576 00000100:00100000:3.0:1788839389.744367:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729336576 00000100:00100000:3.0:1788839389.744448:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:3.0:1788839389.744458:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+44:2358:x1875733729336576:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839389.744469:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839389.744494:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb24e expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.744506:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb08280300) 00010000:00010000:3.0:1788839389.744516:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839389.744538:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+43:2358:x1875733729336576:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 83us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839389.744545:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:3.0:1788839389.753219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839389.753262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.753414:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729336960 00000100:00100000:0.0:1788839389.753425:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729336960 00000100:00100000:0.0:1788839389.753503:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:0.0:1788839389.753513:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+6:2355:x1875733729336960:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:0.0:1788839389.753562:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.753587:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.753596:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839389.753601:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839389.753606:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.753647:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.753662:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 6 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839389.753678:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747153920:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839389.753770:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839389.754047:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729336704 00000100:00100000:2.0:1788839389.754078:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729336704 00002000:00100000:2.0:1788839389.754112:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91eb107aa680 x1875733729336704/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:535/0 lens 504/0 e 0 to 0 dl 1788839400 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839389.754123:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb107aa680 with x1875733729336704 ext(0->8) 00010000:00010000:2.0:1788839389.754130:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 7 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.754142:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 7 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839389.754149:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb107aa680 00000100:00100000:2.0:1788839389.754171:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:2.0:1788839389.754180:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729336704:12345-192.168.201.9@tcp:4:lfs.0 00000100:00100000:2.0:1788839389.754671:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729336704:12345-192.168.201.9@tcp:4:lfs.0 Request processed in 490us (1462us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788839389.754680:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00002000:00100000:2.0:1788839389.754688:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91eb107aa680 x1875733729336704/t4294967308(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:535/0 lens 504/448 e 0 to 0 dl 1788839400 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839389.754710:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb107aa680 with x1875733729336704 ext(0->8) 00010000:00010000:2.0:1788839389.754717:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.754730:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839389.754737:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eb107aa680 00000100:00100000:1.0:1788839389.756688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.757007:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729336832 00000100:00100000:0.0:1788839389.757016:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729336832 00000100:00100000:0.0:1788839389.757105:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:0.0:1788839389.757117:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729336832:12345-192.168.201.9@tcp:16:kworker.0 00000100:00100000:3.0:1788839389.762992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.763744:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cafd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875733747153920:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839389.763772:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839389.765009:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729337088 00000100:00100000:2.0:1788839389.765020:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729337088 00010000:00010000:2.0:1788839389.765101:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 10 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839389.765148:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:2.0:1788839389.765158:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+10:2357:x1875733729337088:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839389.765173:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788839389.765190:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788839389.765193:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788839390 00002000:00010000:2.0:1788839389.765196:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788839390 00002000:00010000:2.0:1788839389.765198:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788839390 00002000:00010000:2.0:1788839389.765200:0:5828:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788839389.765206:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 10 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.765220:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 10 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.765254:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640a2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb240 expref: 10 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.765270:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839389.765275:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839389.765281:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.765291:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.765325:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839389.765384:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2357:x1875733729337088:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 227us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839389.765403:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 77 00010000:00010000:1.0:1788839389.766364:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766380:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766420:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766429:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766438:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766445:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839389.766460:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766470:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766495:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839389.766503:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a1ca8f6/0x4b63896d63640a69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839389.766582:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2355:x1875733729336960:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 13067us (13316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839389.766591:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:0.0:1788839389.791014:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839389.794703:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729337344 00000100:00100000:3.0:1788839389.794719:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729337344 00000100:00100000:3.0:1788839389.794787:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:3.0:1788839389.794798:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+43:11587:x1875733729337344:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:3.0:1788839389.794877:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb255 expref: 43 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839389.795426:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788839389.795542:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788839389.795909:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788839389.795991:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.796010:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.796020:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.797679:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.797720:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 47 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839389.797740:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb107a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875733747154048:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839389.797870:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839389.801977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.802015:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729337472 00000100:00100000:0.0:1788839389.802025:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729337472 00000100:00100000:3.0:1788839389.802449:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb107a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875733747154048:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839389.802491:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.802627:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 48 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839389.802670:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:0.0:1788839389.802681:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+48:2358:x1875733729337472:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839389.802697:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839389.802705:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 48 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.802719:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 48 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.802748:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6200/0x4b63896d63640a15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb232 expref: 48 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.802781:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb08280300) 00010000:00010000:0.0:1788839389.802787:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.802797:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.802806:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.803004:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839389.803172:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+47:2358:x1875733729337472:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 491us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839389.803180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 78 00010000:00010000:3.0:1788839389.803383:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.803400:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839389.803589:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788839389.803802:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788839389.803949:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb107a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875733747154176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788839389.804006:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839389.804042:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839389.804308:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747154176 00000100:00100000:0.0:1788839389.804316:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747154176 00000100:00100000:0.0:1788839389.804371:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839389.804380:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875733747154176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788839389.804466:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875733747154176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839389.804554:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb107a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875733747154176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788839389.805571:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788839389.805693:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788839389.806428:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788839389.808923:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb107a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875733747154304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788839389.809004:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839389.809035:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839389.809082:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747154304 00000100:00100000:3.0:1788839389.809094:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747154304 00000100:00100000:3.0:1788839389.809132:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839389.809141:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875733747154304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788839389.809402:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1875733747154304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 249us (385us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788839389.809411:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839389.809455:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb107a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875733747154304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788839389.809521:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788839389.809567:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.809578:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.809586:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.809593:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839389.809598:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.809605:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.809622:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb08280300) 00010000:00010000:3.0:1788839389.809625:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788839389.809629:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839389.809635:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640a70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788839389.809811:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788839389.809916:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788839389.809926:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372500875863ns, next at 373500873904ns, rc = 0 00000001:00080000:3.0:1788839389.809932:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788839389.809963:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb08280300) 00010000:00010000:3.0:1788839389.809966:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788839389.809973:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb255 expref: 51 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839389.810090:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+50:11587:x1875733729337344:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 15294us (19085us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788839389.810098:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000020:00080000:3.0:1788839389.810102:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788839389.814909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839389.819747:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729337600 00000100:00100000:2.0:1788839389.819767:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729337600 00000100:00100000:2.0:1788839389.819830:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 203 00000100:00100000:2.0:1788839389.819843:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+50:11587:x1875733729337600:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839389.819867:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839389.819890:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640a77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb25c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.819957:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640a77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb25c expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.820016:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640a77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb25c expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839389.820040:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839389.820044:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839389.820078:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09eba400, rc 0) 00000100:00100000:2.0:1788839389.820154:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+51:11587:x1875733729337600:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 314us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839389.820161:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 203 00000001:00080000:0.0:1788839389.821790:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788839389.821825:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1788839389.822463:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2358:x1875733729336832:12345-192.168.201.9@tcp:16:kworker.0 Request processed in 65343us (65778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839389.822547:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:0.0:1788839389.831186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839389.831332:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729337856 00000100:00100000:1.0:1788839389.831343:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729337856 00000100:00100000:1.0:1788839389.831420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:1.0:1788839389.831432:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+51:11587:x1875733729337856:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1788839389.831720:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+52:11587:x1875733729337856:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 289us (543us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788839389.831729:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:2.0:1788839389.952258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839389.952643:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729337984 00000100:00100000:0.0:1788839389.952671:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729337984 00000100:00100000:0.0:1788839389.952753:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 204 00000100:00100000:0.0:1788839389.952767:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+52:11597:x1875733729337984:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:0.0:1788839389.952876:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.952901:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.952915:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.952934:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.952942:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.952948:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953186:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953196:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953203:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839389.953263:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953290:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953297:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953304:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953311:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.953316:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953325:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953342:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839389.953345:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839389.953352:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.953358:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640a7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954172:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954188:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954196:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954215:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.954219:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954226:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954240:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb08280d00) 00010000:00010000:0.0:1788839389.954243:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839389.954247:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954254:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640a85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954274:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954281:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954287:0:8483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954292:0:8483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6e00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839389.954295:0:8483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954300:0:8483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954316:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:0.0:1788839389.954319:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839389.954322:0:8483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839389.954328:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6e00/0x4b63896d63640a8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839389.955311:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+52:11597:x1875733729337984:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 2535us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839389.955325:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 204 00000100:00100000:0.0:1788839390.003737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.004107:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729338240 00000100:00100000:2.0:1788839390.004123:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729338240 00000100:00100000:2.0:1788839390.004301:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 205 00000100:00100000:2.0:1788839390.004315:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+52:11600:x1875733729338240:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839390.004344:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839390.004373:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640a93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb263 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004501:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004514:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004568:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004576:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004583:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004741:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640aa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004751:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004758:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839390.004768:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788839390.004916:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004925:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004933:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004940:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839390.004945:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.004966:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005484:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839390.005487:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839390.005494:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005500:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640a9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005518:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005524:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005530:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005536:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebae00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839390.005539:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005558:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005566:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb03866800) 00010000:00010000:2.0:1788839390.005569:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839390.005572:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005593:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640aa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005657:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640a93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb263 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005673:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb263 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.005681:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839390.005684:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839390.005686:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb800, rc 0) 00000100:00100000:2.0:1788839390.005789:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+54:11600:x1875733729338240:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1477us (2066us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788839390.005798:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 205 00000100:00100000:3.0:1788839390.012985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.013521:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729338368 00000100:00100000:1.0:1788839390.013537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729338368 00000100:00100000:1.0:1788839390.013790:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00100000:1.0:1788839390.013806:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+54:11600:x1875733729338368:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:1.0:1788839390.013964:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014005:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014021:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014098:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014108:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014115:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014122:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ca00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839390.014128:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014136:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014150:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839390.014153:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839390.014160:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.014169:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640ab6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839390.014307:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+54:11600:x1875733729338368:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 504us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.014314:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00100000:3.0:1788839390.024332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839390.024520:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729338624 00000100:00100000:0.0:1788839390.024533:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729338624 00000100:00100000:0.0:1788839390.024620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:0.0:1788839390.024632:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+54:11600:x1875733729338624:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1788839390.024959:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+55:11600:x1875733729338624:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 328us (641us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788839390.026221:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:3.0:1788839390.144968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.145312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729338880 00000100:00100000:1.0:1788839390.145326:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729338880 00000100:00100000:1.0:1788839390.145552:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 207 00000100:00100000:1.0:1788839390.145567:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+55:11610:x1875733729338880:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839390.145602:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839390.145607:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788839390.145644:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7800/0x4b63896d63640a38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb247 expref: 55 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.145669:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839390.145675:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839390.145694:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640abd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb26a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.145831:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640ac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.145849:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.145859:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839390.145872:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788839390.146329:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640abd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb26a expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.146475:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb26a expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.146486:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839390.146489:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839390.146493:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d600, rc 0) 00000100:00100000:1.0:1788839390.146691:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+56:11610:x1875733729338880:12345-192.168.201.9@tcp:101:bash.0 Request processed in 1126us (1737us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788839390.146703:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 207 00000100:00100000:0.0:1788839390.156437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839390.156668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729339136 00000100:00100000:3.0:1788839390.156683:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729339136 00000100:00100000:3.0:1788839390.156757:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 208 00000100:00100000:3.0:1788839390.156771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+56:11610:x1875733729339136:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:3.0:1788839390.156858:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788839390.156894:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d600/0x4b63896d63640ac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb26a expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.156961:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640aa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb263 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.156985:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:3.0:1788839390.156992:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839390.157558:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.157580:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.157593:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839390.157662:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788839390.157689:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b6acf3c reply state 00000000068ec835 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839390.157701:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839390.157988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+57:11610:x1875733729339136:12345-192.168.201.9@tcp:36:bash.0 Request processed in 1216us (1564us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788839390.157998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 208 00000020:00080000:3.0:1788839390.158005:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788839390.164632:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.164655:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.164665:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.164672:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839390.164678:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.164687:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.164734:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839390.164737:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839390.164744:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.164751:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640ad2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839390.164874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.164980:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729339264 00000100:00100000:2.0:1788839390.164997:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729339264 00000100:00100000:2.0:1788839390.165102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 209 00000100:00100000:2.0:1788839390.165271:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+56:11610:x1875733729339264:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839390.165309:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839390.165333:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640ad9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb271 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.165493:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.165511:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.165525:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839390.165564:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788839390.165570:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839390.165597:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.165645:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebae00/0x4b63896d63640ad9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.165666:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.165674:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839390.165676:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839390.165679:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb600, rc 0) 00000100:00100000:2.0:1788839390.165826:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+57:11610:x1875733729339264:12345-192.168.201.9@tcp:101:bash.0 Request processed in 714us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839390.165834:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 209 00000100:00100000:2.0:1788839390.170848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.170957:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729339520 00000100:00100000:1.0:1788839390.171032:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729339520 00000100:00100000:1.0:1788839390.171360:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:1.0:1788839390.171394:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+57:11610:x1875733729339520:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:1.0:1788839390.171747:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+58:11610:x1875733729339520:12345-192.168.201.9@tcp:35:bash.0 Request processed in 365us (911us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788839390.171756:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:1.0:1788839390.251738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839390.251837:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729339648 00000100:00100000:0.0:1788839390.251852:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729339648 00000100:00100000:0.0:1788839390.252005:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 210 00000100:00100000:0.0:1788839390.252019:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+58:11616:x1875733729339648:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839390.252086:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839390.252145:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640ae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb278 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.252233:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640aee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.252247:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.252256:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839390.252300:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788839390.252303:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839390.252322:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.252355:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640ae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb278 expref: 60 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.252401:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640aee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb278 expref: 59 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.252413:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:0.0:1788839390.252416:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839390.252421:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7c00, rc 0) 00000100:00100000:0.0:1788839390.252518:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+59:11616:x1875733729339648:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 501us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839390.252525:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 210 00000100:00100000:3.0:1788839390.255481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.255614:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729339776 00000100:00100000:1.0:1788839390.255626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729339776 00000100:00100000:1.0:1788839390.255699:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:1.0:1788839390.255710:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+59:11616:x1875733729339776:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1788839390.255736:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839390.255764:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640af5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb27f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.255877:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.255899:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256445:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256470:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256478:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256485:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256595:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256601:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256606:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839390.256646:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788839390.256650:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839390.256666:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256690:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256698:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256703:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256708:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256713:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9dc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839390.256716:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256722:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256733:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839390.256735:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839390.256739:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256743:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640afc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256754:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256759:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256767:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256770:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839390.256772:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256775:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256779:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb05a79000) 00010000:00010000:1.0:1788839390.256780:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839390.256782:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256785:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d63640b03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256819:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ca00/0x4b63896d63640af5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256833:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.256839:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839390.256841:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839390.256843:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c000, rc 0) 00000100:00100000:1.0:1788839390.259666:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1e5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11616:x1875733729339776:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 3941us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.259701:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:2.0:1788839390.263624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839390.263695:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729340032 00000100:00100000:3.0:1788839390.263713:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729340032 00000100:00100000:3.0:1788839390.263795:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:3.0:1788839390.263809:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11616:x1875733729340032:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839390.263870:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839390.263904:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640b11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb286 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.264254:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.264274:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.264282:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.264290:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.264338:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.264355:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 61 pid: 5844 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839390.264371:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbe3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747154432:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839390.264548:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.264555:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 61 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839390.264573:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3cbe2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747154560:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839390.264595:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839390.265916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839390.266752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729340160 00000100:00100000:0.0:1788839390.266787:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729340160 00010000:00010000:0.0:1788839390.266843:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 62 pid: 5844 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839390.266942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:0.0:1788839390.266954:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+62:2358:x1875733729340160:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839390.266981:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839390.266989:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 62 pid: 5844 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.267005:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 62 pid: 5844 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.267033:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:0.0:1788839390.267041:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.267077:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.267085:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839390.267230:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+62:2358:x1875733729340160:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 277us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839390.267239:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00010000:00010000:1.0:1788839390.268204:0:5842:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.9@tcp) returned -22 from blocking AST (req@00000000782ed71c x1875733747154432) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 61 pid: 5844 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.268229:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c000/0x4b63896d63640b0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb27f expref: 61 pid: 5844 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839390.268248:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbe3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747154432:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839390.268265:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3cbe2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747154560:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839390.268302:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839390.268307:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.268316:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.268326:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839390.269402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839390.269590:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729340288 00000100:00100000:0.0:1788839390.269602:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729340288 00010000:00010000:0.0:1788839390.269649:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 61 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839390.269713:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:0.0:1788839390.269722:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+61:2357:x1875733729340288:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839390.269743:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839390.269749:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 61 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.269759:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 61 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.269780:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb600/0x4b63896d63640ae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb271 expref: 61 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.269795:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:0.0:1788839390.269799:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.269807:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.269814:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.269884:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839390.269957:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+60:2357:x1875733729340288:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 234us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839390.269966:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00010000:00010000:1.0:1788839390.270791:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.270805:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839390.270834:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788839390.271262:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640b11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.271282:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.271289:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839390.271292:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839390.271294:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e800, rc 0) 00000100:00100000:1.0:1788839390.271468:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11616:x1875733729340032:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 7662us (7859us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788839390.271475:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:1.0:1788839390.274331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839390.274448:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729340544 00000100:00100000:3.0:1788839390.274464:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729340544 00000100:00100000:3.0:1788839390.274556:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1788839390.274569:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11616:x1875733729340544:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:3.0:1788839390.274593:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839390.274630:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba400/0x4b63896d63640a77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb25c expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.274653:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:3.0:1788839390.274658:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839390.274732:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+59:11616:x1875733729340544:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 165us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839390.274740:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1788839390.276241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.276305:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729340672 00000100:00100000:2.0:1788839390.276318:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729340672 00000100:00100000:2.0:1788839390.276377:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:2.0:1788839390.276406:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+59:11616:x1875733729340672:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:2.0:1788839390.276541:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.276559:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.276569:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839390.276773:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788839390.276886:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+59:11616:x1875733729340672:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 486us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839390.276895:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:2.0:1788839390.279443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839390.279721:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729340800 00000100:00100000:0.0:1788839390.279750:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729340800 00000100:00100000:0.0:1788839390.279814:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 214 00000100:00100000:0.0:1788839390.279827:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+59:11616:x1875733729340800:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839390.279859:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839390.279890:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb28d expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.280233:0:8483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.280249:0:8483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 60 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.280276:0:8483:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.280290:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 60 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.280303:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:0.0:1788839390.280306:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839390.280309:0:8483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 60 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.280315:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6800, rc 0) 00000100:00100000:0.0:1788839390.280441:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11616:x1875733729340800:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 615us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839390.280446:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 214 00010000:00010000:0.0:1788839390.591139:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839390.782447:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839390.782461:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839390.782511:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788839390.782522:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788839390.782696:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40adca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747154688:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839390.782850:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839390.793516:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40adca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747154688:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788839390.804350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.804596:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729340928 00000100:00100000:1.0:1788839390.804615:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729340928 00000100:00100000:1.0:1788839390.804788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:1.0:1788839390.804813:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11618:x1875733729340928:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839390.804862:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839390.805034:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11618:x1875733729340928:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 226us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.805043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:2.0:1788839390.819286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.820192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729341056 00000100:00100000:1.0:1788839390.820203:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729341056 00000100:00100000:1.0:1788839390.820265:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:1.0:1788839390.820277:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11618:x1875733729341056:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788839390.820357:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820412:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820426:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820495:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820503:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820509:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820533:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820541:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820547:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839390.820592:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788839390.820596:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839390.820609:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820621:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820636:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820643:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820651:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9dc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839390.820655:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820664:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820678:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:1.0:1788839390.820681:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839390.820686:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820693:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640b34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820708:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820714:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820720:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820725:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839390.820734:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820741:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820748:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff91eb05a79000) 00010000:00010000:1.0:1788839390.820751:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839390.820755:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820776:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820783:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820788:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820794:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9cc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839390.820796:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820802:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820808:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839390.820810:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839390.820819:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.820826:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839390.821121:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11618:x1875733729341056:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 843us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.821129:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:3.0:1788839390.828195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.828385:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729341312 00000100:00100000:2.0:1788839390.828401:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729341312 00000100:00100000:2.0:1788839390.828478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:2.0:1788839390.828490:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+60:11618:x1875733729341312:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839390.828517:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839390.828541:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640b49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb294 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828652:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828668:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828680:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839390.828692:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788839390.828810:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828819:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828827:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828848:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839390.828852:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828860:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828874:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839390.828878:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788839390.828883:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828890:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828936:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640b49 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb294 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828946:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:2.0:1788839390.828949:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839390.828965:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640b49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb294 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.828975:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebbe00, rc 0) 00000100:00100000:2.0:1788839390.829106:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+61:11618:x1875733729341312:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 561us (866us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788839390.829114:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:3.0:1788839390.833603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.833703:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729341440 00000100:00100000:1.0:1788839390.833715:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729341440 00000100:00100000:1.0:1788839390.833776:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:1.0:1788839390.833787:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+61:11618:x1875733729341440:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839390.833821:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839390.833944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+61:11618:x1875733729341440:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 159us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.833952:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:3.0:1788839390.850425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.851153:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729341696 00000100:00100000:2.0:1788839390.851181:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729341696 00000100:00100000:2.0:1788839390.851303:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 219 00000100:00100000:2.0:1788839390.851315:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+61:11618:x1875733729341696:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839390.851335:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839390.851338:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788839390.851391:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640aee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb278 expref: 61 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.851411:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839390.851416:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839390.851430:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640b5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb29b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839390.855606:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788839390.855847:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.855865:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.855877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.856842:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640b5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb29b expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.856869:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb29b expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.857729:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb03866800) 00010000:00010000:2.0:1788839390.857732:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839390.857736:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb000, rc 0) 00000100:00100000:2.0:1788839390.857873:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+62:11618:x1875733729341696:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 6558us (7457us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788839390.857882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 219 00000100:00100000:3.0:1788839390.866400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.866727:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729341952 00000100:00100000:2.0:1788839390.866738:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729341952 00000100:00100000:2.0:1788839390.866837:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:2.0:1788839390.866849:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+62:11618:x1875733729341952:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839390.867463:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839390.867493:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb000/0x4b63896d63640b65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb29b expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867512:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb03866800) 00010000:00010000:2.0:1788839390.867523:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839390.867546:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867561:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867572:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867586:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867613:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867620:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867683:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867691:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867697:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867704:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebbc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839390.867839:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867849:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867858:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839390.867862:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839390.867866:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867873:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbc00/0x4b63896d63640b73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.867883:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.868019:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.868026:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.868032:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839390.868035:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.868043:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.868085:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb6aef9d0 (ffff91eb03866500) 00010000:00010000:2.0:1788839390.868088:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839390.868092:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.868098:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb6aef9d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839390.868251:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+61:11618:x1875733729341952:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1403us (1860us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839390.868259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:3.0:1788839390.873168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.873339:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729342080 00000100:00100000:1.0:1788839390.873350:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729342080 00000100:00100000:1.0:1788839390.873425:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 221 00000100:00100000:1.0:1788839390.873436:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+61:11618:x1875733729342080:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839390.873457:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839390.873481:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2a2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.873519:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.873539:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.873566:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.873664:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.873682:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.873691:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:1.0:1788839390.873694:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839390.873698:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c200, rc 0) 00000100:00100000:1.0:1788839390.873761:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+62:11618:x1875733729342080:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 327us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.873768:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 221 00000100:00100000:3.0:1788839390.878103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839390.878349:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729342336 00000100:00100000:0.0:1788839390.878360:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729342336 00000100:00100000:0.0:1788839390.878431:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 222 00000100:00100000:0.0:1788839390.878443:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+62:11618:x1875733729342336:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839390.878542:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.878559:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.878570:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839390.878820:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788839390.878831:0:8483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373569780558ns, next at 374569777396ns, rc = 0 00000004:00010000:0.0:1788839390.879042:0:8483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b1dbf19 reply state 00000000df352636 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839390.879213:0:8483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839390.879440:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+64:11618:x1875733729342336:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 997us (1390us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788839390.879466:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 222 00010000:00010000:0.0:1788839390.882593:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.882613:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.882621:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.882627:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839390.882633:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.882641:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.882660:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:0.0:1788839390.882664:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788839390.882669:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.882676:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640b8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839390.884664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.884904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729342464 00000100:00100000:2.0:1788839390.884916:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729342464 00000100:00100000:2.0:1788839390.884979:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 223 00000100:00100000:2.0:1788839390.884990:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+63:11618:x1875733729342464:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839390.885017:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839390.885074:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2a9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.885140:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.885155:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839390.885176:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:2.0:1788839390.885179:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839390.885182:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb200, rc 0) 00000100:00100000:2.0:1788839390.885252:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+64:11618:x1875733729342464:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 263us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839390.885259:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 223 00000100:00100000:3.0:1788839390.889345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.889597:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729342592 00000100:00100000:2.0:1788839390.889607:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729342592 00000100:00100000:2.0:1788839390.889689:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:2.0:1788839390.889700:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb409fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729342592:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788839390.889822:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839390.890005:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb409fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+10:2358:x1875733729342592:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 306us (667us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788839390.890013:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:3.0:1788839390.892742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839390.892847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729342848 00000100:00100000:0.0:1788839390.892857:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729342848 00000100:00100000:0.0:1788839390.892929:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:0.0:1788839390.892940:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+64:11618:x1875733729342848:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788839390.893523:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+65:11618:x1875733729342848:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 583us (788us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788839390.893531:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:3.0:1788839390.896513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.896759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729343104 00000100:00100000:2.0:1788839390.896769:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729343104 00000100:00100000:2.0:1788839390.896827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:2.0:1788839390.896837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+65:11618:x1875733729343104:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788839390.896966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+65:11618:x1875733729343104:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 130us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839390.896985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:3.0:1788839390.900943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.901045:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729343232 00000100:00100000:1.0:1788839390.901092:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729343232 00000100:00100000:1.0:1788839390.901274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 225 00000100:00100000:1.0:1788839390.901286:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+65:11618:x1875733729343232:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839390.901307:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839390.901328:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2b0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.901419:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.901434:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.901461:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839390.901497:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839390.901516:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.901543:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63640b9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b0 expref: 67 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.901560:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b0 expref: 66 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.901568:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:1.0:1788839390.901571:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788839390.901575:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9dc00, rc 0) 00000100:00100000:1.0:1788839390.901638:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+66:11618:x1875733729343232:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 354us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.901645:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 225 00000100:00100000:3.0:1788839390.907319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.907458:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729343360 00000100:00100000:1.0:1788839390.907470:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729343360 00000100:00100000:1.0:1788839390.907528:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:1.0:1788839390.907538:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+10:2357:x1875733729343360:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839390.907559:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839390.907580:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2b7 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839390.907631:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f85df, blocks: 0x1 00010000:00010000:1.0:1788839390.907650:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1788839390.907655:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839390.907665:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.907681:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839390.907694:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9cc00, rc 0) 00000100:00100000:1.0:1788839390.907759:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+11:2357:x1875733729343360:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 222us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.907766:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:3.0:1788839390.912380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.912538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729343616 00000100:00100000:2.0:1788839390.912549:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729343616 00000100:00100000:2.0:1788839390.912614:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 226 00000100:00100000:2.0:1788839390.912625:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+66:11618:x1875733729343616:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788839390.912735:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+66:11618:x1875733729343616:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 112us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839390.912742:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 226 00000100:00100000:2.0:1788839390.916826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839390.916936:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729343744 00000100:00100000:3.0:1788839390.916946:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729343744 00000100:00100000:3.0:1788839390.917115:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:3.0:1788839390.917195:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+11:11618:x1875733729343744:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839390.917213:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839390.917230:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2be expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.917260:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.917269:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839390.917273:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839390.917278:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.917314:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.917329:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 12 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839390.917383:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875733747154816:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839390.917519:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788839390.921318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839390.922023:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875733747154816:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839390.922082:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.922107:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:0.0:1788839390.922390:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729343872 00000100:00100000:0.0:1788839390.922398:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729343872 00010000:00010000:0.0:1788839390.922438:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 13 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839390.922478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:0.0:1788839390.922489:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2357:x1875733729343872:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839390.922506:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839390.922529:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 13 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.922541:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 13 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.922563:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a45718a/0x4b63896d63640bab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b7 expref: 13 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.922579:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839390.922584:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839390.922593:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.922627:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839390.922663:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839390.922678:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40adca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875733747154944:192.168.201.9@tcp:105: 00000100:00100000:0.0:1788839390.922781:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05014c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839390.926233:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40adca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875733747154944:192.168.201.9@tcp:105: 00010000:00010000:1.0:1788839390.926262:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839390.926328:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+12:2357:x1875733729343872:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 3840us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839390.926339:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:2.0:1788839390.926962:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+11:11618:x1875733729343744:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 9760us (10137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839390.926972:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:0.0:1788839390.931693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839390.931777:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729344000 00000100:00100000:1.0:1788839390.931789:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729344000 00002000:00100000:1.0:1788839390.931855:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91eb40adc380 x1875733729344000/t0(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:536/0 lens 504/0 e 0 to 0 dl 1788839401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839390.931869:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb40adc380 with x1875733729344000 ext(0->12) 00002000:00010000:1.0:1788839390.931875:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb40adc380 00000100:00100000:1.0:1788839390.931928:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:1.0:1788839390.931940:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+11:2358:x1875733729344000:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788839390.932513:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729344000:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 573us (832us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788839390.932523:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00002000:00100000:1.0:1788839390.932530:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91eb40adc380 x1875733729344000/t4294967320(0) o4->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:536/0 lens 504/448 e 0 to 0 dl 1788839401 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839390.932539:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb40adc380 with x1875733729344000 ext(0->12) 00002000:00010000:1.0:1788839390.932543:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb40adc380 00000100:00100000:3.0:1788839390.935691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839390.935797:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729344128 00000100:00100000:2.0:1788839390.935807:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729344128 00000100:00100000:2.0:1788839390.935865:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 227 00000100:00100000:2.0:1788839390.935876:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+66:11618:x1875733729344128:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788839390.984583:0:12474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788839390.984602:0:12474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788839390.984636:0:12474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb05014a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788839390.984640:0:12474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb05adea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb05014840 00000020:00080000:1.0:1788839390.984643:0:12474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb05ade200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb3314fc00 00000004:00080000:1.0:1788839390.984699:0:12474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1788839390.984733:0:12474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788839390.984745:0:12474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb3309c240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788839390.984748:0:12474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb40733600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb3309cd80 00000020:00080000:1.0:1788839390.984751:0:12474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb40733400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb37062800 00000020:00080000:1.0:1788839390.984777:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1788839390.985187:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747155072:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788839390.985254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839390.985317:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747155072 00000100:00100000:3.0:1788839390.985326:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747155072 00000100:00100000:3.0:1788839390.985404:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788839390.985414:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875733747155072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788839390.985441:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788839390.985474:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f85de, atime: 0x6a9f85de, ctime: 0x6a9f85de, blocks: 0xb 00010000:00010000:3.0:1788839390.985482:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.985500:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1788839390.985506:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839390.985514:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.985551:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.985561:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.985568:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.985585:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788839390.986480:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747155072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1064us (1223us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788839390.986489:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1788839390.986526:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839390.986532:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.986542:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839390.986546:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.986556:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.986575:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.986592:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000727e2aa2/0x4b63896d63640bb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.986614:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839390.986616:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839390.986618:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839390.986651:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788839390.986656:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb3711a680, transno 4294967307 00000100:00100000:3.0:1788839390.986671:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eb107a8380 x1875733747154304/t4294967309(4294967309) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1788839405 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_000.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788839390.986681:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb3357fb80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788839390.986686:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747155072:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788839390.987083:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788839390.987478:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11618:x1875733729344128:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 51599us (51791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839390.987488:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 227 00000100:00100000:0.0:1788839390.988350:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839390.988394:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747155328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788839390.988447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839390.988491:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747155328 00000100:00100000:0.0:1788839390.988498:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747155328 00000100:00100000:0.0:1788839390.988542:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839390.988550:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747155328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788839390.988690:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788839390.988693:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788839391 00002000:00010000:0.0:1788839390.988696:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788839390.988697:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788839391 -> 1788839391 00002000:00010000:0.0:1788839390.988700:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788839390.988740:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875733747155328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (293us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788839390.988747:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788839390.988785:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb40ade300/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788839390.988805:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747155328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788839390.989801:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747155200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788839390.989838:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839390.991800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839390.991835:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747155200 00000100:00100000:3.0:1788839390.991842:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747155200 00000100:00100000:3.0:1788839390.991882:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729344256 00000100:00100000:3.0:1788839390.992187:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729344256 00000100:00100000:3.0:1788839390.992215:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788839390.992224:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747155200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788839390.992251:0:9213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788839390.992284:0:9213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.992303:0:9213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.992313:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788839390.992317:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839390.992322:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.992503:0:9213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839390.992518:0:9213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 13 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839390.992532:0:9213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747155456:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839390.992666:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:0.0:1788839390.992676:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3711a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+13:2358:x1875733729344256:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788839390.992781:0:9213:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788839391.000586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839391.000624:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729344384 00000100:00100000:1.0:1788839391.000632:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729344384 00010000:00010000:1.0:1788839391.000669:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 14 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839391.000721:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:1.0:1788839391.000731:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2358:x1875733729344384:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839391.000762:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839391.000769:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 14 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.000784:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 14 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.000812:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839391.000816:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839391.000823:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.000833:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.000853:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839391.000910:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+14:2358:x1875733729344384:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 180us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839391.000918:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 82 00010000:00010000:3.0:1788839391.012175:0:9213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d6364097b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb21d expref: 13 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.012202:0:9213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747155456:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839391.012229:0:9213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.012263:0:9213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.012269:0:9213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.012277:0:9213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.012282:0:9213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.012299:0:9213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839391.012324:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839391.012331:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.012340:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839391.012344:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.012363:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.012396:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.012402:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d38d67e/0x4b63896d63640bc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.012420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839391.012422:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839391.012424:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839391.014305:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1875733747155200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22075us (24460us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788839391.014317:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:3.0:1788839391.014389:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb40adf800/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788839391.014397:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747155200:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788839391.045304:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1788839391.045322:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788839391.045562:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3711a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2358:x1875733729344256:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 52882us (53763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839391.045574:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:1.0:1788839391.053099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839391.054268:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729344640 00000100:00100000:2.0:1788839391.054281:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729344640 00000100:00100000:3.0:1788839391.054443:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 228 00000100:00100000:3.0:1788839391.054454:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11618:x1875733729344640:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788839391.054507:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839391.054535:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640ba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2b0 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.054571:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:3.0:1788839391.054576:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839391.054608:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.054621:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.054631:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788839391.055128:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788839391.055483:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6f12472 reply state 00000000a2910d65 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.055495:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839391.055599:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+21:11618:x1875733729344640:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1146us (2510us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788839391.055607:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 228 00010000:00010000:2.0:1788839391.059786:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.059805:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.059813:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.059839:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839391.059844:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.059851:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.059869:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:2.0:1788839391.059872:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839391.059877:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.059883:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839391.062617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.062829:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729344768 00000100:00100000:3.0:1788839391.062839:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729344768 00000100:00100000:3.0:1788839391.062913:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:3.0:1788839391.062925:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729344768:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788839391.063399:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788839391.063404:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788839391 -> 1788839391 00002000:00010000:3.0:1788839391.063407:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788839390 00002000:00010000:3.0:1788839391.063410:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788839391 -> 1788839391 00002000:00010000:3.0:1788839391.063412:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788839391.063535:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2355:x1875733729344768:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 612us (926us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788839391.063543:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:0.0:1788839391.069573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.069669:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729345024 00000100:00100000:3.0:1788839391.069680:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729345024 00000100:00100000:3.0:1788839391.069768:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 229 00000100:00100000:3.0:1788839391.069780:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11618:x1875733729345024:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788839391.069853:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.069871:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.069882:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.069929:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.069943:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 20 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.069967:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747155584:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839391.070079:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839391.072787:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875733747155584:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839391.072823:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839391.075823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.075930:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729345152 00000100:00100000:3.0:1788839391.075939:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729345152 00010000:00010000:3.0:1788839391.075987:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 21 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.076032:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:3.0:1788839391.076042:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+21:2358:x1875733729345152:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839391.076098:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839391.076106:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 21 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.076130:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 21 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.076153:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c200/0x4b63896d63640b88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a2 expref: 21 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.076170:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:3.0:1788839391.076175:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.076184:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.076192:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.076227:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839391.076284:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+20:2358:x1875733729345152:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 242us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839391.076292:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00010000:00010000:2.0:1788839391.076684:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076693:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076721:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076728:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076735:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076741:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839391.076753:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076761:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076771:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:2.0:1788839391.076774:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788839391.076778:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.076784:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f400/0x4b63896d63640bce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839391.076840:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11618:x1875733729345024:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 7062us (7274us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788839391.076849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 229 00000100:00100000:0.0:1788839391.080341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.080512:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729345280 00000100:00100000:3.0:1788839391.080524:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729345280 00000100:00100000:3.0:1788839391.080588:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:3.0:1788839391.080600:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729345280:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788839391.080646:0:9213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.080666:0:9213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.080675:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839391.080679:0:9213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839391.080684:0:9213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.080722:0:9213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.080738:0:9213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 8 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.080752:0:9213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747155712:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839391.080927:0:9213:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839391.084836:0:9213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9213:1875733747155712:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839391.084895:0:9213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839391.086982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839391.087458:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729345408 00000100:00100000:1.0:1788839391.087467:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729345408 00010000:00010000:1.0:1788839391.087527:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 9 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839391.087573:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:1.0:1788839391.087584:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+9:2358:x1875733729345408:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839391.087599:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839391.087623:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 9 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.087637:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 9 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.087662:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa8d414c/0x4b63896d63640bb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2be expref: 9 pid: 6697 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.087681:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839391.087685:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839391.087691:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.087703:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.087736:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839391.087797:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729345408:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 215us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839391.087806:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 84 00010000:00010000:3.0:1788839391.087872:0:9213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087883:0:9213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087923:0:9213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087932:0:9213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087941:0:9213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087955:0:9213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839391.087960:0:9213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087969:0:9213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087981:0:9213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.087995:0:9213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da32c162/0x4b63896d63640bd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.088043:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2357:x1875733729345280:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 7446us (7711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839391.088091:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:0.0:1788839391.092186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.092377:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729345664 00000100:00100000:3.0:1788839391.092387:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729345664 00000100:00100000:3.0:1788839391.092439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 230 00000100:00100000:3.0:1788839391.092449:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11618:x1875733729345664:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788839391.092537:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.092555:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.092566:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.092813:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.092826:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.092834:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.092906:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.092922:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 20 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.092937:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747155840:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839391.093035:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839391.097978:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40bffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747155840:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839391.098007:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839391.100686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839391.100773:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729345792 00000100:00100000:1.0:1788839391.100783:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729345792 00010000:00010000:1.0:1788839391.100829:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 21 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839391.100865:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:1.0:1788839391.100876:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+21:2357:x1875733729345792:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839391.100910:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839391.100918:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 21 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.100932:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 21 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.100964:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640b96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2a9 expref: 21 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.100983:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:1.0:1788839391.100988:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.100999:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.101007:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.101041:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839391.101132:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:2357:x1875733729345792:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 257us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839391.101153:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 85 00010000:00010000:0.0:1788839391.101316:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.101325:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839391.101532:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788839391.101670:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788839391.101712:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788839391.101789:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747155968:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788839391.101841:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839391.101879:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1e593300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839391.102631:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747155968 00000100:00100000:1.0:1788839391.102639:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747155968 00000100:00100000:1.0:1788839391.102699:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839391.102708:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875733747155968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839391.102793:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875733747155968:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839391.102800:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788839391.102920:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839391.102958:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788839391.102963:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788839391.102981:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb40ade300, transno 4294967321 00000100:00100000:0.0:1788839391.103003:0:5842:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eb40adf800 x1875733747155200/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788839406 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839391.103015:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747155968:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788839391.104290:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788839391.104490:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747156096:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788839391.104557:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839391.104591:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839391.104820:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747156096 00000100:00100000:1.0:1788839391.104828:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747156096 00000100:00100000:1.0:1788839391.104874:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839391.104893:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875733747156096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839391.105141:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875733747156096:12345-0@lo:1000:mdt00_000.0 Request processed in 258us (583us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788839391.105149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839391.106142:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875733747156096:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788839391.106181:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106192:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106200:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106206:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839391.106211:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106219:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106235:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:0.0:1788839391.106238:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839391.106242:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106249:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640be3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106280:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106287:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106307:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106312:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839391.106315:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106321:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106329:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:0.0:1788839391.106332:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839391.106339:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 23 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106362:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 23 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106380:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 23 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839391.106411:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 23 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839391.106423:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747156224:192.168.201.9@tcp:105: 00000100:00100000:0.0:1788839391.106497:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839391.114640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.115372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729345920 00000100:00100000:3.0:1788839391.115383:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729345920 00000100:00100000:3.0:1788839391.115444:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:3.0:1788839391.115454:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11616:x1875733729345920:12345-192.168.201.9@tcp:49:lfs.0 00000100:00100000:3.0:1788839391.115594:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11616:x1875733729345920:12345-192.168.201.9@tcp:49:lfs.0 Request processed in 141us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839391.115601:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:3.0:1788839391.118529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839391.118663:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729346176 00000100:00100000:0.0:1788839391.118683:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729346176 00000100:00100000:0.0:1788839391.118736:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 231 00000100:00100000:0.0:1788839391.118745:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11616:x1875733729346176:12345-192.168.201.9@tcp:58:lfs.0 00000040:00080000:0.0:1788839391.119625:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788839391.119774:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+24:11616:x1875733729346176:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 1027us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839391.119783:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 231 00000100:00100000:2.0:1788839391.119941:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875733747156224:192.168.201.9@tcp:105: 00010000:00010000:2.0:1788839391.119978:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.119989:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb800/0x4b63896d63640b26 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120022:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120037:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120074:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120094:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120102:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120108:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120192:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebaa00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839391.120197:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120206:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120218:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839391.120221:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839391.120225:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120231:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebaa00/0x4b63896d63640bea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120242:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120248:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120254:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120265:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839391.120268:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120274:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120284:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839391.120286:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839391.120288:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.120293:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640bdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839391.120435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11618:x1875733729345664:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 27986us (28260us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788839391.120443:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 230 00000020:00080000:2.0:1788839391.120447:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788839391.120652:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839391.120657:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839391.120691:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788839391.120695:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788839391.120799:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09fcd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747156352:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839391.120854:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb011ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839391.128498:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09fcd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875733747156352:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788839391.131545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839391.131918:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729346304 00000100:00100000:0.0:1788839391.131927:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729346304 00000100:00100000:0.0:1788839391.134305:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:0.0:1788839391.134330:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11619:x1875733729346304:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788839391.134372:0:8483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788839391.134490:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11619:x1875733729346304:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 172us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839391.134498:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:3.0:1788839391.140494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.147666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839391.147704:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729346816 00000100:00100000:3.0:1788839391.149339:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729346816 00000100:00100000:3.0:1788839391.149436:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:3.0:1788839391.149464:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+23:11618:x1875733729346816:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788839391.150670:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788839391.150781:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788839391.150842:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.150862:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.150875:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.150894:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839391.155484:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729346560 00000100:00100000:2.0:1788839391.155499:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729346560 00010000:00010000:3.0:1788839391.155584:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.155597:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.155621:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788839391.155722:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+26:11618:x1875733729346816:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 6258us (8065us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788839391.155731:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000020:00080000:3.0:1788839391.155736:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788839391.155793:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839391.155800:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.155807:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839391.155823:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.155833:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.155847:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eb0c453300) 00010000:00010000:3.0:1788839391.155850:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788839391.155855:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.155862:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640bf1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.155878:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839391.155880:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839391.155882:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839391.160258:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 233 00000100:00100000:1.0:1788839391.160282:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+25:11619:x1875733729346560:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839391.160306:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839391.160329:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640bf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2c5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.160456:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d63640bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.160472:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d63640bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.160504:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d63640bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839391.160518:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788839391.160648:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640bf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2c5 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.160667:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d63640bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2c5 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.160675:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839391.160679:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788839391.160683:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9da00, rc 0) 00000100:00100000:1.0:1788839391.160749:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+27:11619:x1875733729346560:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 478us (20263us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788839391.160757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 233 00000100:00100000:3.0:1788839391.176838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839391.177150:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729347072 00000100:00100000:1.0:1788839391.177162:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729347072 00000100:00100000:1.0:1788839391.177227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 234 00000100:00100000:1.0:1788839391.177237:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+27:11619:x1875733729347072:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788839391.177342:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177394:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177408:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177651:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177659:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177665:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177671:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9dc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839391.177675:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177682:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177694:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839391.177697:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839391.177701:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.177706:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9dc00/0x4b63896d63640c0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839391.177874:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+28:11619:x1875733729347072:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 637us (1043us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788839391.177882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 234 00000040:00080000:2.0:1788839391.179380:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839391.179391:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839391.181293:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788839391.181311:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839391.189785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839391.189913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729347200 00000100:00100000:0.0:1788839391.189923:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729347200 00000100:00100000:0.0:1788839391.189998:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 235 00000100:00100000:0.0:1788839391.190008:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+28:11621:x1875733729347200:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839391.190029:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839391.190105:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640c14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2cc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190346:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190519:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190532:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190548:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190556:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190575:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190815:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190828:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190837:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190870:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839391.190886:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 29 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.190901:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3caff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747156480:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839391.191004:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839391.195226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839391.195679:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729347456 00000100:00100000:0.0:1788839391.195690:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729347456 00000100:00100000:0.0:1788839391.195765:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:0.0:1788839391.195776:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+30:11619:x1875733729347456:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788839391.196096:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+31:11619:x1875733729347456:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 276us (835us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788839391.196104:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:3.0:1788839391.200124:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3caff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875733747156480:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839391.200163:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839391.201250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839391.201558:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729347712 00000100:00100000:0.0:1788839391.201567:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729347712 00000100:00100000:0.0:1788839391.201628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:0.0:1788839391.201639:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3caff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+31:5595:x1875733729347712:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788839391.201907:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3caff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:5595:x1875733729347712:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 269us (661us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788839391.201916:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:0.0:1788839391.207586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839391.207673:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729347840 00000100:00100000:1.0:1788839391.207685:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729347840 00010000:00010000:1.0:1788839391.207730:0:8458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 32 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839391.207792:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:1.0:1788839391.207803:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+32:2358:x1875733729347840:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839391.207823:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839391.207830:0:8458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 32 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.207844:0:8458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 32 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.207867:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e800/0x4b63896d63640b18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb286 expref: 32 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.207885:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839391.207891:0:8458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.207917:0:8458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.207925:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839391.207968:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839391.208010:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839391.208026:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07d32060-78a7-4509-9f5d-feb437ccdae6+31:2358:x1875733729347840:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 225us (451us total) trans 0 rc 0/0 00010000:00010000:2.0:1788839391.208029:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839391.208033:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 86 00000004:00200000:2.0:1788839391.208089:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788839391.208094:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839391.208114:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208128:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208138:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208145:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208151:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208157:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839391.208161:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208168:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208177:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:2.0:1788839391.208180:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839391.208183:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208199:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ec00/0x4b63896d63640c1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208211:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208216:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208222:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208226:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839391.208229:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208235:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208244:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eb0c453300) 00010000:00010000:2.0:1788839391.208246:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839391.208249:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208255:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e200/0x4b63896d63640c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208302:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6c00/0x4b63896d63640c14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2cc expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208317:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2cc expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839391.208330:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:2.0:1788839391.208332:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839391.208334:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ea00, rc 0) 00000100:00100000:2.0:1788839391.208385:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+30:11621:x1875733729347200:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 18377us (18608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839391.208392:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 235 00010000:00010000:1.0:1788839391.613647:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788839391.945647:0:12563:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839391.945660:0:12563:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839391.945717:0:12563:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788839391.945724:0:12563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788839392.173808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839392.177551:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348096 00000100:00100000:3.0:1788839392.177564:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348096 00000100:00100000:3.0:1788839392.177616:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 236 00000100:00100000:3.0:1788839392.177624:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+30:11644:x1875733729348096:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839392.177648:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839392.177667:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2d3 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839392.177752:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640c37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839392.177763:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839392.177771:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839392.177779:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788839392.177894:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63640c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2d3 expref: 33 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839392.177912:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640c37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2d3 expref: 32 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839392.177921:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:3.0:1788839392.177925:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788839392.177928:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:3.0:1788839392.177995:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11644:x1875733729348096:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 370us (4197us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788839392.178010:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 236 00000100:00100000:0.0:1788839392.190085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839392.190131:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348224 00000100:00100000:0.0:1788839392.190141:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348224 00000100:00100000:0.0:1788839392.190195:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 237 00000100:00100000:0.0:1788839392.190204:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11644:x1875733729348224:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1788839392.190281:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190318:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190330:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190368:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190376:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190384:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190389:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839392.190393:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190400:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190413:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:0.0:1788839392.190475:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839392.190483:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839392.190491:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7c00/0x4b63896d63640c45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839392.190564:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+32:11644:x1875733729348224:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 360us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839392.190583:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 237 00000100:00100000:1.0:1788839392.297569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839392.297640:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348352 00000100:00100000:3.0:1788839392.297649:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348352 00000100:00100000:3.0:1788839392.297783:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:3.0:1788839392.297796:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729348352:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:3.0:1788839392.297824:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839392.297844:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008564389d/0x4b63896d63640c4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2da expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839392.297873:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f85df, atime: 0x6a9f85de, ctime: 0x6a9f85df, blocks: 0xb 00010000:00010000:3.0:1788839392.297893:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1788839392.297897:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839392.297908:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008564389d/0x4b63896d63640c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2da expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839392.297927:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008564389d/0x4b63896d63640c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2da expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839392.297939:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e000, rc 0) 00000100:00080000:0.0:1788839392.298215:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839392.298655:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2355:x1875733729348352:12345-192.168.201.9@tcp:101:cat.0 Request processed in 859us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839392.298664:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:0.0:1788839392.303995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839392.304243:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348480 00000100:00100000:2.0:1788839392.304253:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348480 00002000:00100000:2.0:1788839392.304498:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91eb09fcd500 x1875733729348480/t0(0) o3->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:538/0 lens 488/0 e 0 to 0 dl 1788839403 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839392.304511:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb09fcd500 with x1875733729348480 ext(0->4095) 00002000:00010000:2.0:1788839392.304519:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb09fcd500 00000100:00100000:2.0:1788839392.304553:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1788839392.304563:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729348480:12345-192.168.201.9@tcp:3:cat.0 00000100:00100000:2.0:1788839392.304783:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2358:x1875733729348480:12345-192.168.201.9@tcp:3:cat.0 Request processed in 219us (798us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788839392.304791:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00002000:00100000:2.0:1788839392.304799:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91eb09fcd500 x1875733729348480/t0(0) o3->07d32060-78a7-4509-9f5d-feb437ccdae6@192.168.201.9@tcp:538/0 lens 488/4536 e 0 to 0 dl 1788839403 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839392.304807:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb09fcd500 with x1875733729348480 ext(0->4095) 00002000:00010000:2.0:1788839392.304885:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb09fcd500 00010000:00010000:3.0:1788839392.637306:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839393.341480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839393.341525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839393.341568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839393.341675:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348992 00000100:00100000:0.0:1788839393.341686:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348992 00000100:00100000:0.0:1788839393.341763:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:0.0:1788839393.341773:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729348992:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839393.341855:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2357:x1875733729348992:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 83us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839393.341863:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00080000:0.0:1788839393.341886:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839393.342045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839393.342094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839393.342113:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348736 00000100:00100000:1.0:1788839393.342117:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348736 00000100:00100000:1.0:1788839393.342144:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729349120 00000100:00100000:1.0:1788839393.342147:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729349120 00000100:00100000:1.0:1788839393.342162:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 170 00000100:00100000:1.0:1788839393.342169:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+32:2357:x1875733729348736:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839393.342204:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+32:2357:x1875733729348736:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 36us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839393.342212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 170 00000100:00100000:1.0:1788839393.342225:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:1.0:1788839393.342231:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729349120:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839393.342251:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:2357:x1875733729349120:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 21us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839393.342258:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:0.0:1788839393.342501:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348864 00000100:00100000:0.0:1788839393.342505:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348864 00000100:00100000:0.0:1788839393.342538:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:0.0:1788839393.342545:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729348864:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839393.342576:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+8:2357:x1875733729348864:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 31us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839393.342582:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00080000:0.0:1788839393.342603:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839393.342881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729348608 00000100:00100000:2.0:1788839393.342886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729348608 00000100:00100000:2.0:1788839393.342951:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 302 00000100:00100000:2.0:1788839393.342973:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729348608:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839393.343020:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2357:x1875733729348608:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 48us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839393.343026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 302 00000100:00100000:2.0:1788839393.597300:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747156992:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597384:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839393.597455:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788839393.597463:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747156608:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597497:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839393.597521:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747157120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597545:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839393.597570:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747156736:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839393.597612:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747157248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839393.597651:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839393.597656:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea011e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747156864:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839393.597710:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747156992 00000100:00100000:2.0:1788839393.597718:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747156992 00000100:00100000:2.0:1788839393.597770:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747157248 00000100:00100000:2.0:1788839393.597773:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747157248 00000100:00100000:2.0:1788839393.597797:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839393.597807:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747156992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597875:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747156992:12345-0@lo:400:kworker.0 Request processed in 69us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839393.597891:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839393.597922:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839393.597929:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747157248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.597965:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3312a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875733747157248:12345-0@lo:400:kworker.0 Request processed in 37us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839393.597972:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839393.597991:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747156608 00000100:00100000:2.0:1788839393.597995:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747156608 00000100:00100000:2.0:1788839393.598032:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788839393.598038:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747156608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598092:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747156608:12345-0@lo:400:kworker.0 Request processed in 53us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839393.598098:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788839393.598124:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747157120 00000100:00100000:2.0:1788839393.598128:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747157120 00000100:00100000:2.0:1788839393.598154:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747156736 00000100:00100000:2.0:1788839393.598156:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747156736 00000100:00100000:2.0:1788839393.598168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747156864 00000100:00100000:2.0:1788839393.598171:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747156864 00000100:00100000:2.0:1788839393.598188:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788839393.598194:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747157120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598223:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747157120:12345-0@lo:400:kworker.0 Request processed in 30us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839393.598230:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788839393.598241:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788839393.598247:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea011e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747156736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598287:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea011e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747156736:12345-0@lo:400:kworker.0 Request processed in 40us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839393.598293:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788839393.598306:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788839393.598313:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747156864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598351:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747156864:12345-0@lo:400:kworker.0 Request processed in 39us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839393.598358:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788839393.598384:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839393.598390:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839393.598392:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839393.598432:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747156864:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598444:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747156736:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598453:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747157248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598485:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747156608:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598494:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747157120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839393.598502:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea011e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747156992:0@lo:400:kworker.0 00010000:00010000:1.0:1788839393.665558:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839394.109651:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747157376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839394.109742:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839394.110024:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747157376 00000100:00100000:1.0:1788839394.110034:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747157376 00000100:00100000:1.0:1788839394.110117:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839394.110129:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747157376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839394.110167:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839394.110477:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3cbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747157376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 349us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839394.110495:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788839394.110571:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747157376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839394.622663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747157504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839394.622762:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839394.622937:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747157504 00000100:00100000:2.0:1788839394.622947:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747157504 00000100:00100000:2.0:1788839394.623005:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839394.623016:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747157504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839394.623076:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839394.623131:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747157504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839394.623150:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839394.623207:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747157504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788839394.688858:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788839395.261513:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1788839395.709275:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788839396.190556:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788839396.190586:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788839396.190979:0:12474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1788839396.190995:0:12474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eb10a50780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788839396.190999:0:12474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb05adec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eb10a500c0 00000020:00080000:3.0:1788839396.191002:0:12474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eb05ade900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eb37061c00 00000020:00080000:3.0:1788839396.191027:0:12474:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788839396.191034:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000001:00080000:3.0:1788839396.191036:0:12474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788839396.191235:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788839396.733242:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839397.366801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839397.366919:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729349248 00000100:00100000:2.0:1788839397.366929:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729349248 00000100:00100000:2.0:1788839397.367018:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 238 00000100:00100000:2.0:1788839397.367031:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11305:x1875733729349248:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788839397.367188:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11305:x1875733729349248:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 Request processed in 160us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839397.367197:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 238 00000100:00080000:0.0:1788839397.368026:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839397.376164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839397.376333:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729349504 00000100:00100000:0.0:1788839397.376345:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729349504 00000100:00100000:0.0:1788839397.376430:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:0.0:1788839397.376446:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:11305:x1875733729349504:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788839397.377121:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:11305:x1875733729349504:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 674us (965us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788839397.377131:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:1.0:1788839397.524671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839397.524755:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729349632 00000100:00100000:2.0:1788839397.524763:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729349632 00000100:00080000:0.0:1788839397.524831:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839397.524854:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 239 00000100:00100000:2.0:1788839397.524862:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+5:12095:x1875733729349632:12345-192.168.201.9@tcp:101:lsof.0 00010000:00010000:2.0:1788839397.524878:0:8483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839397.524896:0:8483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640c53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2e1 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839397.524962:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640c5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839397.524974:0:8483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839397.524983:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839397.525033:0:8483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788839397.525036:0:8483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839397.525090:0:8483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839397.525113:0:8483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebbe00/0x4b63896d63640c53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2e1 expref: 7 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839397.525129:0:8483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640c5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2e1 expref: 6 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839397.525135:0:8483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:2.0:1788839397.525137:0:8483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839397.525140:0:8483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb200, rc 0) 00000100:00100000:2.0:1788839397.525200:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:12095:x1875733729349632:12345-192.168.201.9@tcp:101:lsof.0 Request processed in 339us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839397.525204:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 239 00010000:00010000:1.0:1788839397.758304:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839398.455321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839398.455374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839398.455432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839398.455446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729349760 00000100:00100000:2.0:1788839398.455459:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729349760 00000100:00100000:0.0:1788839398.455462:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350016 00000100:00100000:0.0:1788839398.455470:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350016 00000100:00100000:1.0:1788839398.455484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839398.455524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839398.455529:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 304 00000100:00100000:2.0:1788839398.455545:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729349760:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839398.455566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350272 00000100:00100000:1.0:1788839398.455571:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350272 00000100:00100000:1.0:1788839398.455603:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729349888 00000100:00100000:1.0:1788839398.455606:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729349888 00000100:00100000:1.0:1788839398.455626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:1.0:1788839398.455634:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2355:x1875733729350272:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839398.455643:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729349760:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839398.455655:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 304 00000100:00100000:1.0:1788839398.455672:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2355:x1875733729350272:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 38us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839398.455692:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:1.0:1788839398.455874:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:1.0:1788839398.455884:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+20:2355:x1875733729349888:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839398.455915:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+20:2355:x1875733729349888:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 34us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839398.456086:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350144 00000100:00100000:0.0:1788839398.456091:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350144 00000100:00100000:0.0:1788839398.456121:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:0.0:1788839398.456130:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729350016:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839398.456162:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2355:x1875733729350016:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 34us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839398.456169:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:0.0:1788839398.456184:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 103 00000100:00100000:0.0:1788839398.456191:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729350144:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839398.456215:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2355:x1875733729350144:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839398.456220:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 103 00000100:00080000:0.0:1788839398.456385:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839398.456391:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839398.461647:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:2.0:1788839398.719157:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747158016:0@lo:400:kworker.0 00000100:00100000:1.0:1788839398.719206:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747157632:0@lo:400:kworker.0 00000100:00100000:3.0:1788839398.719322:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747157888:0@lo:400:kworker.0 00000100:00100000:0.0:1788839398.719395:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747157760:0@lo:400:kworker.0 00000100:00100000:2.0:1788839398.719433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839398.719522:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158016 00000100:00100000:2.0:1788839398.719530:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158016 00000100:00100000:2.0:1788839398.719580:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788839398.719589:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747158016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839398.719637:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747158016:12345-0@lo:400:kworker.0 Request processed in 48us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839398.719643:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788839398.719665:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839398.719686:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788839398.719691:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb40adf800, transno 4294967322 00000004:00080000:2.0:1788839398.719701:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788839398.719723:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747158016:0@lo:400:kworker.0 00000100:00100000:3.0:1788839398.721628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839398.721867:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747157888 00000100:00100000:2.0:1788839398.721875:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747157888 00000100:00100000:2.0:1788839398.721936:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788839398.721948:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747157888:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788839398.721952:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839398.722016:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747157888:12345-0@lo:400:kworker.0 Request processed in 72us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839398.722024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788839398.722065:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747157888:0@lo:400:kworker.0 00000100:00100000:1.0:1788839398.722481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839398.722527:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747158144:0@lo:400:kworker.0 00000100:00100000:1.0:1788839398.722562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839398.722709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839398.722873:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747157632 00000100:00100000:2.0:1788839398.722878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747157632 00000100:00100000:2.0:1788839398.722923:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788839398.722930:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747158272:0@lo:400:kworker.0 00000100:00100000:2.0:1788839398.722935:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747157632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839398.723091:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158144 00000100:00100000:3.0:1788839398.723096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158144 00000100:00100000:3.0:1788839398.723141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747157760 00000100:00100000:3.0:1788839398.723145:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747157760 00000100:00100000:3.0:1788839398.723165:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788839398.723172:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3c8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747158144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839398.723383:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839398.723419:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158272 00000100:00100000:0.0:1788839398.723423:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158272 00000100:00100000:0.0:1788839398.723453:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788839398.723460:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747158272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839398.723499:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747158272:12345-0@lo:400:kworker.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839398.723506:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788839398.723541:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788839398.723547:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788839398.723565:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb3357fb80, transno 4294967310 00000100:00100000:0.0:1788839398.723578:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747158272:0@lo:400:kworker.0 00000100:00080000:0.0:1788839398.723614:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839398.723617:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839398.723628:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788839398.723636:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747157760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839398.723688:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747157760:12345-0@lo:400:kworker.0 Request processed in 53us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839398.723695:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788839398.723811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747157632:12345-0@lo:400:kworker.0 Request processed in 880us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839398.723820:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788839398.723889:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747157760:0@lo:400:kworker.0 00000100:00100000:3.0:1788839398.723953:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3c8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747158144:12345-0@lo:400:kworker.0 Request processed in 780us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839398.723960:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788839398.724200:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747157632:0@lo:400:kworker.0 00000100:00100000:0.0:1788839398.724216:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747158144:0@lo:400:kworker.0 00010000:00010000:0.0:1788839398.785214:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839399.229852:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747158400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839399.230038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839399.237230:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158400 00000100:00100000:2.0:1788839399.237274:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158400 00000100:00100000:2.0:1788839399.237374:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788839399.237388:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747158400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839399.237662:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839399.237784:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747158400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 399us (7745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839399.237793:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839399.238149:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747158400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839399.742103:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747158528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839399.742189:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839399.742420:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158528 00000100:00100000:2.0:1788839399.742430:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158528 00000100:00100000:2.0:1788839399.742488:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788839399.742498:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747158528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839399.742536:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839399.742598:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747158528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839399.742607:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788839399.742970:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747158528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839399.805354:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839400.664563:0:12767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:50:00 (1788839400) 00010000:00010000:0.0:1788839400.831133:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839401.413206:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839401.413221:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839401.413647:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788839401.413656:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788839401.427728:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788839401.427759:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788839401.428396:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788839401.428417:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788839401.855081:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839402.882432:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839403.576114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839403.576175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839403.576218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839403.576246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839403.576276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839403.576328:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350912 00000100:00100000:0.0:1788839403.576344:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350912 00000100:00100000:0.0:1788839403.576426:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350528 00000100:00100000:0.0:1788839403.576430:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350528 00000100:00100000:0.0:1788839403.576462:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:0.0:1788839403.576475:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2356:x1875733729350912:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839403.576592:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2356:x1875733729350912:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 121us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.576602:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:0.0:1788839403.576622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 181 00000100:00100000:0.0:1788839403.576631:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:2356:x1875733729350528:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839403.576658:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+19:2356:x1875733729350528:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.576665:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 181 00000100:00100000:0.0:1788839403.576695:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350656 00000100:00100000:0.0:1788839403.576699:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350656 00000100:00100000:0.0:1788839403.576729:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350784 00000100:00100000:0.0:1788839403.576731:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350784 00000100:00100000:0.0:1788839403.576754:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:0.0:1788839403.576762:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729350656:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839403.576816:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2356:x1875733729350656:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 55us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.576823:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:0.0:1788839403.576836:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:0.0:1788839403.576843:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729350784:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839403.576869:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2356:x1875733729350784:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.576875:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00080000:0.0:1788839403.576894:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839403.576899:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839403.576903:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839403.577260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729350400 00000100:00100000:1.0:1788839403.577266:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729350400 00000100:00100000:1.0:1788839403.577318:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 306 00000100:00100000:1.0:1788839403.577327:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729350400:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839403.577369:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7913c62c-0094-46f9-ba19-31fffcffa164+13:2356:x1875733729350400:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 43us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839403.577376:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 306 00000100:00100000:3.0:1788839403.839446:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747158912:0@lo:400:kworker.0 00000100:00100000:3.0:1788839403.839570:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839403.839658:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788839403.839664:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb09f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747158784:0@lo:400:kworker.0 00000100:00100000:3.0:1788839403.839689:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839403.839705:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747159296:0@lo:400:kworker.0 00000100:00100000:3.0:1788839403.839729:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839403.839822:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747158656:0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.839860:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839403.839894:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747159168:0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.839917:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839403.839936:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839403.839941:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747159040:0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.839961:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839403.839994:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158912 00000100:00100000:0.0:1788839403.840003:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158912 00000100:00100000:0.0:1788839403.840082:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158784 00000100:00100000:0.0:1788839403.840086:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158784 00000100:00100000:0.0:1788839403.840099:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159168 00000100:00100000:0.0:1788839403.840102:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159168 00000100:00100000:0.0:1788839403.840120:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788839403.840130:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747158912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840216:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747158912:12345-0@lo:400:kworker.0 Request processed in 87us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.840225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788839403.840247:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788839403.840253:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747158784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840283:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747158784:12345-0@lo:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.840289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788839403.840298:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788839403.840304:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747159168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840333:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747159168:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.840340:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788839403.840363:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159296 00000100:00100000:0.0:1788839403.840366:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159296 00000100:00100000:0.0:1788839403.840393:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159040 00000100:00100000:0.0:1788839403.840396:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159040 00000100:00100000:0.0:1788839403.840414:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788839403.840420:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840453:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747159296:12345-0@lo:400:kworker.0 Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.840460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788839403.840471:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839403.840476:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747159040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840500:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747159040:12345-0@lo:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839403.840515:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788839403.840539:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839403.840544:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839403.840546:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839403.840590:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747159040:0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840601:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747159168:0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840632:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb09f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747158784:0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840642:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747159296:0@lo:400:kworker.0 00000100:00100000:0.0:1788839403.840652:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747158912:0@lo:400:kworker.0 00000100:00100000:3.0:1788839403.840971:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747158656 00000100:00100000:3.0:1788839403.840976:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747158656 00000100:00100000:3.0:1788839403.841024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788839403.841031:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747158656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839403.841107:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747158656:12345-0@lo:400:kworker.0 Request processed in 77us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839403.841113:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788839403.841719:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747158656:0@lo:400:kworker.0 00010000:00010000:1.0:1788839403.902837:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839404.352414:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839404.352450:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747159424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839404.352611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839404.352965:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159424 00000100:00100000:2.0:1788839404.352976:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159424 00000100:00100000:2.0:1788839404.353080:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788839404.353093:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747159424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839404.353292:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839404.353382:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747159424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 291us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839404.353391:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788839404.353591:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747159424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839404.861550:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839404.864893:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747159552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839404.864975:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839404.865530:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159552 00000100:00100000:2.0:1788839404.865542:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159552 00000100:00100000:2.0:1788839404.865623:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788839404.865634:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747159552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839404.865676:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839404.865793:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747159552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839404.865801:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788839404.872281:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747159552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839404.929391:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839405.949722:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839406.617527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839406.617658:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729351168 00000100:00100000:3.0:1788839406.617675:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729351168 00000100:00100000:3.0:1788839406.617864:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:3.0:1788839406.617879:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+19:12316:x1875733729351168:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:3.0:1788839406.618493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:12316:x1875733729351168:12345-192.168.201.9@tcp:35:umount.0 Request processed in 615us (984us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788839406.618501:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00080000:0.0:1788839406.618843:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839406.628221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839406.628896:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729351424 00000100:00100000:0.0:1788839406.628989:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729351424 00000100:00100000:0.0:1788839406.629274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:0.0:1788839406.629290:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+20:12316:x1875733729351424:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:0.0:1788839406.630317:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+21:12316:x1875733729351424:12345-192.168.201.9@tcp:35:umount.0 Request processed in 1017us (2098us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788839406.630333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:3.0:1788839406.633330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839406.633447:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729351680 00000100:00100000:2.0:1788839406.633462:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729351680 00000100:00100000:2.0:1788839406.633592:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:2.0:1788839406.633605:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2de3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+21:12316:x1875733729351680:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:2.0:1788839406.633986:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2de3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+22:12316:x1875733729351680:12345-192.168.201.9@tcp:35:umount.0 Request processed in 382us (674us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788839406.633995:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:1.0:1788839406.637419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839406.637557:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729351936 00000100:00100000:0.0:1788839406.637590:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729351936 00000100:00100000:0.0:1788839406.637666:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:0.0:1788839406.637689:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+22:12316:x1875733729351936:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:0.0:1788839406.638807:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+23:12316:x1875733729351936:12345-192.168.201.9@tcp:35:umount.0 Request processed in 1110us (1392us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788839406.638822:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:3.0:1788839406.642427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839406.642487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839406.642824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839406.644257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839406.644461:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729352064 00000100:00100000:0.0:1788839406.644474:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729352064 00000100:00100000:0.0:1788839406.644555:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729352192 00000100:00100000:0.0:1788839406.644559:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729352192 00000100:00100000:0.0:1788839406.644582:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729352320 00000100:00100000:0.0:1788839406.644586:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729352320 00000100:00100000:0.0:1788839406.644620:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:0.0:1788839406.644634:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb02fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+15:2355:x1875733729352064:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839406.644657:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839406.644696:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9d200/0x4b63896d6363fcd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae6c expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839406.644722:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839406.644800:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb02fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+14:2355:x1875733729352064:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 168us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839406.644808:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:0.0:1788839406.644877:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:0.0:1788839406.644884:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+13:2355:x1875733729352192:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839406.644892:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839406.645167:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20964000/0x4b63896d6363fc38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae34 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839406.645199:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839406.645225:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+12:2355:x1875733729352192:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 340us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839406.645232:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:0.0:1788839406.645247:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1788839406.645254:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+11:2356:x1875733729352320:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839406.645263:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839406.645274:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6a00/0x4b63896d6363fee6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf37 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839406.645283:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839406.645301:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+10:2356:x1875733729352320:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 47us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839406.645307:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1788839406.645346:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729352448 00000100:00100000:0.0:1788839406.645352:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729352448 00000100:00100000:0.0:1788839406.645404:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:0.0:1788839406.645413:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+5:2354:x1875733729352448:12345-192.168.201.9@tcp:9:umount.0 00000020:00000080:0.0:1788839406.645450:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363ffaa 00000100:00080000:0.0:1788839406.645464:0:6696:0:(import.c:65:import_set_state_nolock()) ffff91eb033ed000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839406.645527:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788839406.646506:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07d32060-78a7-4509-9f5d-feb437ccdae6+2:2354:x1875733729352448:12345-192.168.201.9@tcp:9:umount.0 Request processed in 1082us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839406.646522:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00080000:0.0:1788839406.646561:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788839406.649362:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839406.675676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839406.677325:0:9213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729352832 00000100:00100000:0.0:1788839406.677363:0:9213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729352832 00000100:00100000:0.0:1788839406.677499:0:9213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:0.0:1788839406.677519:0:9213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2354:x1875733729352832:12345-192.168.201.9@tcp:9:umount.0 00000020:00000080:0.0:1788839406.677571:0:9213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6364020b 00000020:00010000:0.0:1788839406.677581:0:9213:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eb033c9000: total 0 00000100:00080000:0.0:1788839406.677588:0:9213:0:(import.c:65:import_set_state_nolock()) ffff91eb033cb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839406.677652:0:9213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:2.0:1788839406.678885:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1788839406.679300:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eb033c9000: total 0 00010000:00010000:1.0:1788839406.679396:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eb033c9000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788839406.679500:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008564389d/0x4b63896d63640c4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2da expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.679552:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c910be/0x4b63896d636405ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb10c expref: 5 pid: 9213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.679569:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eb033c9000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788839406.679582:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839406.679585:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839406.679587:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839406.680680:0:9213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07d32060-78a7-4509-9f5d-feb437ccdae6+2:2354:x1875733729352832:12345-192.168.201.9@tcp:9:umount.0 Request processed in 3158us (5014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839406.680699:0:9213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:0.0:1788839406.694415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839406.694603:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729353856 00000100:00100000:2.0:1788839406.694618:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729353856 00000100:00100000:2.0:1788839406.694709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 240 00000100:00100000:2.0:1788839406.694723:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+23:2354:x1875733729353856:12345-192.168.201.9@tcp:39:umount.0 00000020:00000080:2.0:1788839406.694782:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fc46 00000020:00010000:2.0:1788839406.694808:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eb37d63000: total 0 00000100:00080000:2.0:1788839406.694815:0:5843:0:(import.c:65:import_set_state_nolock()) ffff91eb37d64800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788839406.694862:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1788839406.696243:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eb37d63000: total 0 00010000:00010000:1.0:1788839406.696256:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839406.696333:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eb37d63000, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1788839406.696384:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839406.696389:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788839406.696403:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9da00/0x4b63896d63640bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2c5 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696430:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:1.0:1788839406.696433:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839406.696438:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63640610 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb128 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696483:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb08280200) 00010000:00010000:1.0:1788839406.696486:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839406.696491:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6400/0x4b63896d6363ff2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf4c expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696511:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839406.696514:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839406.696518:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7e00/0x4b63896d6364056f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0f7 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696533:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eb08280c00) 00010000:00010000:1.0:1788839406.696535:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839406.696540:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c7600/0x4b63896d6363ff10 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf45 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696556:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839406.696558:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788839406.696562:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63640599 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb105 expref: 17 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696576:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839406.696578:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839406.696582:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09eba200/0x4b63896d6364090b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb201 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696597:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839406.696599:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788839406.696610:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63640c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2d3 expref: 15 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696627:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eb0c453200) 00010000:00010000:1.0:1788839406.696629:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788839406.696633:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364062c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb12f expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696650:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eb0c453d00) 00010000:00010000:1.0:1788839406.696652:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839406.696656:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d400/0x4b63896d6364048f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb0bf expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696681:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839406.696684:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788839406.696688:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d6363ff80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf61 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696701:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839406.696704:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839406.696707:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb102c6800/0x4b63896d63640b2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb28d expref: 11 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696717:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eb03866d00) 00010000:00010000:1.0:1788839406.696720:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839406.696723:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ea00/0x4b63896d63640c29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2cc expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696736:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eb05a79f00) 00010000:00010000:1.0:1788839406.696744:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839406.696749:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c600/0x4b63896d6364026d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb033 expref: 9 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839406.696777:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eb37d63000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1788839406.696792:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839406.696794:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839406.696796:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839406.697476:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07d32060-78a7-4509-9f5d-feb437ccdae6+7:2354:x1875733729353856:12345-192.168.201.9@tcp:39:umount.0 Request processed in 2748us (3069us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788839406.697490:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 240 00010000:00010000:1.0:1788839406.973800:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839407.997342:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839408.699991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839408.700121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839408.700301:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729354112 00000100:00100000:2.0:1788839408.700316:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729354112 00000100:00100000:2.0:1788839408.700434:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00100000:2.0:1788839408.700449:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2357:x1875733729354112:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839408.700549:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2357:x1875733729354112:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 104us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839408.700558:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00080000:3.0:1788839408.700637:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839408.700705:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729353984 00000100:00100000:0.0:1788839408.700711:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729353984 00000100:00100000:0.0:1788839408.700761:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 308 00000100:00100000:0.0:1788839408.700770:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:2357:x1875733729353984:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839408.700803:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7913c62c-0094-46f9-ba19-31fffcffa164+10:2357:x1875733729353984:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839408.700810:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 308 00000100:00100000:2.0:1788839408.958506:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747160064:0@lo:400:kworker.0 00000100:00100000:2.0:1788839408.958616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839408.958730:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788839408.958739:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747159680:0@lo:400:kworker.0 00000100:00100000:2.0:1788839408.958777:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839408.958806:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747160192:0@lo:400:kworker.0 00000100:00100000:2.0:1788839408.958838:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839408.958874:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159680 00000100:00100000:2.0:1788839408.958883:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159680 00000100:00100000:2.0:1788839408.958936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788839408.958947:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747159680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839408.959007:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3311:x1875733747159680:12345-0@lo:400:kworker.0 Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839408.959015:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788839408.959115:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747159680:0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.959532:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747159808:0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.959579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839408.959612:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747160320:0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.959651:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839408.959674:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839408.959680:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747159936:0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.959706:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839408.959748:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160192 00000100:00100000:3.0:1788839408.959754:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160192 00000100:00100000:3.0:1788839408.959801:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159808 00000100:00100000:3.0:1788839408.959804:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159808 00000100:00100000:3.0:1788839408.959817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747159936 00000100:00100000:3.0:1788839408.959820:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747159936 00000100:00100000:3.0:1788839408.959836:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788839408.959844:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747160192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.959895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747160192:12345-0@lo:400:kworker.0 Request processed in 51us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839408.959903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788839408.959918:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788839408.959924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747159808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.959958:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747159808:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839408.959964:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788839408.959995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788839408.960001:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747159936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.960079:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747159936:12345-0@lo:400:kworker.0 Request processed in 45us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839408.960087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1788839408.960110:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839408.960139:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747159936:0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.960151:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747159808:0@lo:400:kworker.0 00000100:00100000:3.0:1788839408.960182:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747160192:0@lo:400:kworker.0 00000100:00100000:1.0:1788839408.960756:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160064 00000100:00100000:1.0:1788839408.960765:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160064 00000100:00100000:1.0:1788839408.960827:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160320 00000100:00100000:1.0:1788839408.960832:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160320 00000100:00100000:1.0:1788839408.960856:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839408.960866:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747160064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839408.960930:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747160064:12345-0@lo:400:kworker.0 Request processed in 65us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839408.960937:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839408.960953:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788839408.960959:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747160320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839408.960996:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747160320:12345-0@lo:400:kworker.0 Request processed in 37us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839408.961003:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788839408.961094:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747160320:0@lo:400:kworker.0 00000100:00080000:3.0:1788839408.962213:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839408.962223:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839408.962268:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747160064:0@lo:400:kworker.0 00010000:00010000:1.0:1788839409.021524:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839409.470186:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747160448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839409.470292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839409.470533:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160448 00000100:00100000:2.0:1788839409.470545:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160448 00000100:00100000:2.0:1788839409.470615:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839409.470627:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747160448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839409.470675:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839409.470777:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747160448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839409.470786:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788839409.471114:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747160448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839409.984668:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839409.984704:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747160576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839409.984818:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839409.985852:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160576 00000100:00100000:2.0:1788839409.985865:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160576 00000100:00100000:2.0:1788839409.985945:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788839409.985958:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747160576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839409.986009:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839409.986215:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747160576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839409.986225:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788839409.988904:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747160576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839410.045686:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839410.563533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839410.563595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839410.563692:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729354240 00000100:00100000:0.0:1788839410.563707:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729354240 00000100:00100000:0.0:1788839410.563889:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729354368 00000100:00100000:0.0:1788839410.563893:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729354368 00000100:00100000:0.0:1788839410.563929:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1788839410.563942:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+11:2356:x1875733729354240:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839410.563965:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839410.563992:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20964600/0x4b63896d6363fd18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae81 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839410.564026:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839410.564155:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+10:2356:x1875733729354240:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 214us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839410.564164:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1788839410.564188:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:0.0:1788839410.564195:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+9:2356:x1875733729354368:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839410.564206:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839410.564216:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c7200/0x4b63896d6363fd1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaeab expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839410.564226:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839410.564247:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7913c62c-0094-46f9-ba19-31fffcffa164+8:2356:x1875733729354368:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 51us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839410.564253:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:0.0:1788839410.565689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839410.571740:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729354496 00000100:00100000:2.0:1788839410.571761:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729354496 00000001:00100000:2.0:1788839410.571783:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:2.0:1788839410.571790:0:7651:0:(genops.c:885:class_export_put()) final put ffff91eb033e9800/07d32060-78a7-4509-9f5d-feb437ccdae6 00000100:00100000:2.0:1788839410.571980:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:2.0:1788839410.571990:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7913c62c-0094-46f9-ba19-31fffcffa164+8:2355:x1875733729354496:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839410.572010:0:8458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839410.572070:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6fc00/0x4b63896d6363fedf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbaf30 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839410.572094:0:8458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839410.572173:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7913c62c-0094-46f9-ba19-31fffcffa164+7:2355:x1875733729354496:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 183us (6495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839410.572182:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000020:00000080:0.0:1788839410.572264:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb033e9800/07d32060-78a7-4509-9f5d-feb437ccdae6 for lustre-OST0001 00000020:00000080:0.0:1788839410.572325:0:12628:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb033ed000 for lustre-OST0001 00000100:00100000:0.0:1788839410.590208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839410.590323:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729354752 00000100:00100000:3.0:1788839410.590338:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729354752 00000100:00100000:3.0:1788839410.590440:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 241 00000100:00100000:3.0:1788839410.590454:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+6:2354:x1875733729354752:12345-192.168.201.9@tcp:39:umount.0 00000020:00000080:3.0:1788839410.590514:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fd2d 00000020:00010000:3.0:1788839410.590525:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eb375e5800: total 0 00000100:00080000:3.0:1788839410.590531:0:5842:0:(import.c:65:import_set_state_nolock()) ffff91eb375e6800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788839410.590764:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eb375e5800: total 0 00010000:00010000:2.0:1788839410.590853:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eb375e5800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788839410.590923:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0c453900) 00010000:00010000:2.0:1788839410.590927:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839410.590938:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09ebb200/0x4b63896d63640c5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2e1 expref: 5 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839410.590972:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eb375e5800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788839410.590984:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839410.590986:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839410.590988:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788839410.591212:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788839410.591525:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e05aa00-5dd5-4619-9642-ae49ffaf889b+3:2354:x1875733729354752:12345-192.168.201.9@tcp:39:umount.0 Request processed in 1072us (1330us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788839410.591548:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 241 00000100:00080000:0.0:1788839410.592330:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839410.626228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839410.626323:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355008 00000100:00100000:3.0:1788839410.626338:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355008 00000100:00100000:3.0:1788839410.626409:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 310 00000100:00100000:3.0:1788839410.626423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+7:2354:x1875733729355008:12345-192.168.201.9@tcp:251:umount.0 00000020:00000080:3.0:1788839410.626488:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fc23 00000020:00010000:3.0:1788839410.626499:0:5838:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eb0a5ae000: total 0 00000100:00080000:3.0:1788839410.626505:0:5838:0:(import.c:65:import_set_state_nolock()) ffff91eb0a5a9800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788839410.626811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7913c62c-0094-46f9-ba19-31fffcffa164+3:2354:x1875733729355008:12345-192.168.201.9@tcp:251:umount.0 Request processed in 389us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839410.626821:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 310 00000020:00010000:1.0:1788839410.627739:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eb0a5ae000: total 0 00010000:00010000:1.0:1788839410.627749:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839410.627845:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eb0a5ae000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788839410.627905:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6000/0x4b63896d6363fcd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbae73 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839410.627928:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eb0a5ae000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788839410.627939:0:5831:0:(genops.c:885:class_export_put()) final put ffff91eb0a5ae000/7913c62c-0094-46f9-ba19-31fffcffa164 00010000:00010000:1.0:1788839410.627972:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839410.627974:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839410.627976:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788839410.628919:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb0a5ae000/7913c62c-0094-46f9-ba19-31fffcffa164 for MGS 00000020:00000080:2.0:1788839410.628995:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb0a5a9800 for MGS 00010000:00010000:1.0:1788839411.069611:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788839411.613102:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1788839411.613135:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000001:00080000:0.0:1788839411.613145:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1788839411.613164:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e05aa00-5dd5-4619-9642-ae49ffaf889b 00000001:00080000:0.0:1788839411.613173:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788839411.613176:0:5864:0:(genops.c:885:class_export_put()) final put ffff91eb375e5800/8e05aa00-5dd5-4619-9642-ae49ffaf889b 00000020:00000080:0.0:1788839411.613193:0:5864:0:(genops.c:885:class_export_put()) final put ffff91eb37d63000/07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:0.0:1788839411.613208:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb375e5800/8e05aa00-5dd5-4619-9642-ae49ffaf889b for lustre-MDT0000 00000020:00000080:0.0:1788839411.613452:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb37d63000/07d32060-78a7-4509-9f5d-feb437ccdae6 for lustre-MDT0000 00000020:00000080:0.0:1788839411.613495:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb375e6800 for lustre-MDT0000 00000020:00000080:0.0:1788839411.613501:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb37d64800 for lustre-MDT0000 00000001:00100000:2.0:1788839411.627779:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:2.0:1788839411.627790:0:6721:0:(genops.c:885:class_export_put()) final put ffff91eb033c9000/07d32060-78a7-4509-9f5d-feb437ccdae6 00000020:00000080:1.0:1788839411.627958:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb033c9000/07d32060-78a7-4509-9f5d-feb437ccdae6 for lustre-OST0000 00000020:00000080:1.0:1788839411.628031:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb033cb800 for lustre-OST0000 00000040:00080000:1.0:1788839411.645278:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839411.645288:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839411.645875:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788839411.645892:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788839412.095273:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839413.117317:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788839413.412466:0:12970:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788839413.432239:0:12970:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788839413.432290:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.432308:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.432316:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.432324:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.432353:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788839413.432360:0:12970:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788839413.432384:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839413.432390:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788839413.432416:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788839413.432440:0:12970:0:(import.c:65:import_set_state_nolock()) ffff91eb331bb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788839413.432549:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839413.432559:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839413.432568:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964a00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:1.0:1788839413.432572:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839413.432581:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839413.432596:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839413.432602:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788839413.432604:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788839413.432607:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788839413.432638:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839413.432645:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839413.432664:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839413.432671:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20964a00/0x4b63896d6363fca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fcaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839413.432683:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839413.432685:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839413.432687:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839413.432706:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747160832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839413.432775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839413.432870:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160832 00000100:00100000:1.0:1788839413.432880:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160832 00000100:00100000:1.0:1788839413.433028:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839413.433072:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+19:3312:x1875733747160832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839413.433088:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839413.433104:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6600/0x4b63896d6363fcaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fca8 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839413.433129:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839413.433168:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2841848a-c637-485f-b8f2-edd7dddc336d+18:3312:x1875733747160832:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839413.433176:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839413.433214:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2841848a-c637-485f-b8f2-edd7dddc336d:3312:1875733747160832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839413.433368:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747160704:0@lo:39:umount.0 00000100:00100000:3.0:1788839413.433406:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839413.433488:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160704 00000100:00100000:0.0:1788839413.433493:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160704 00000100:00100000:0.0:1788839413.433531:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788839413.433539:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875733747160704:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788839413.433561:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fa32 00000100:00080000:0.0:1788839413.433569:0:5843:0:(import.c:65:import_set_state_nolock()) ffff91eb3377a800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788839413.433638:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875733747160704:12345-0@lo:39:umount.0 Request processed in 100us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839413.433646:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788839413.433654:0:5843:0:(genops.c:885:class_export_put()) final put ffff91eb33778000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788839413.433861:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788839413.433883:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb331bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788839413.433897:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747160704:0@lo:39:umount.0 00000100:00080000:0.0:1788839413.434009:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839413.434012:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788839413.434017:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839413.435207:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb33778000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788839413.435290:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb3377a800 for lustre-MDT0000 00010000:00010000:0.0:1788839413.436546:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436568:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436577:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436586:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436616:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839413.436623:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436649:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436656:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436662:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436674:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788839413.436681:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436688:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436695:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436703:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436711:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788839413.436717:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436723:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436739:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436745:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839413.436752:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788839413.436756:0:12970:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788839413.436782:0:12970:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788839413.436787:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788839413.436791:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839413.436798:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788839413.436805:0:12970:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91eb37d62800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788839413.436810:0:12970:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91eb40429000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788839413.436815:0:12970:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff91eb33773370) has exports, disconnecting them 00000020:00080000:0.0:1788839413.436821:0:12970:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91eb37d62800), last request at 1788839408 00000020:00000080:0.0:1788839413.436829:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fba5 00000100:00080000:0.0:1788839413.436851:0:12970:0:(import.c:65:import_set_state_nolock()) ffff91eb37d65800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788839413.436904:0:12970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eb37d62800): rc 0 00010000:00010000:3.0:1788839413.437564:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788839413.437576:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437585:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d800 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839413.437589:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437600:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839413.437621:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839413.437627:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839413.437629:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788839413.437632:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788839413.437674:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437681:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839413.437708:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437715:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d6363fcb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fcbd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437728:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788839413.437732:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437738:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7000 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839413.437741:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437748:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839413.437754:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839413.437769:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839413.437771:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788839413.437773:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788839413.437788:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437794:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839413.437800:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437807:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb102c7000/0x4b63896d6363fbdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fbe4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437822:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839413.437825:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437830:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e400 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839413.437833:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437840:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839413.437846:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839413.437851:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788839413.437853:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788839413.437855:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788839413.437875:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437880:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839413.437896:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437903:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e400/0x4b63896d6363fed1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fed8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437913:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839413.437930:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437936:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14528c00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839413.437940:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.437947:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839413.437953:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839413.437958:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839413.437960:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788839413.437962:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788839413.438009:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.438016:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839413.438022:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.438035:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14528c00/0x4b63896d6363f991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363f998 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.438076:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839413.438079:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839413.438081:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839413.438100:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747160960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839413.438171:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839413.438222:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839413.438229:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747161088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839413.438253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839413.438308:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747160960 00000100:00100000:3.0:1788839413.438314:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747160960 00000100:00100000:3.0:1788839413.438366:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747161088 00000100:00100000:3.0:1788839413.438369:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747161088 00000100:00100000:3.0:1788839413.438394:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839413.438406:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb2ed76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+19:3313:x1875733747160960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839413.438422:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839413.438438:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14528400/0x4b63896d6363fcbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fcb6 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.438451:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839413.438500:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb2ed76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+18:3313:x1875733747160960:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839413.438508:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839413.438556:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788839413.438563:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+17:3313:x1875733747161088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839413.438578:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839413.438587:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6f000/0x4b63896d6363fbe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fbdd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.438599:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839413.438635:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2841848a-c637-485f-b8f2-edd7dddc336d+16:3313:x1875733747161088:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839413.438642:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788839413.438755:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747161216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839413.438783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839413.438805:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839413.438811:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747161344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839413.438831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839413.438854:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747161216 00000100:00100000:3.0:1788839413.438859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747161216 00000100:00100000:3.0:1788839413.438881:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747161344 00000100:00100000:3.0:1788839413.438884:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747161344 00000100:00100000:3.0:1788839413.438898:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839413.438905:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+17:3311:x1875733747161216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839413.438913:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839413.438921:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09ebac00/0x4b63896d6363fed8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fed1 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.438934:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839413.438961:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+16:3311:x1875733747161216:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839413.438979:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839413.438991:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839413.439004:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+15:3311:x1875733747161344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839413.439013:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839413.439022:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb00031200/0x4b63896d6363f998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363f991 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.439033:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839413.439076:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2841848a-c637-485f-b8f2-edd7dddc336d+14:3311:x1875733747161344:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839413.439082:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839413.439149:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747161344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839413.439157:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747161216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839413.439176:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839413.439190:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747161088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839413.439198:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2841848a-c637-485f-b8f2-edd7dddc336d:3313:1875733747160960:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788839413.439978:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb37d62800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788839413.440011:0:12970:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91eb40429000), last request at 1788839408 00000020:00000080:0.0:1788839413.440019:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fada 00000100:00080000:0.0:1788839413.440030:0:12970:0:(import.c:65:import_set_state_nolock()) ffff91eb4042b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788839413.440080:0:12970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eb40429000): rc 0 00000020:00000080:0.0:1788839413.440082:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb40429000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788839413.440091:0:12970:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb24422bfae0 00000100:00080000:0.0:1788839413.440119:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839413.440134:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788839413.440154:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788839413.440224:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788839413.440251:0:12970:0:(import.c:65:import_set_state_nolock()) ffff91eb37138000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788839413.440266:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788839413.440269:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788839413.440279:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788839413.440345:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788839413.440355:0:12970:0:(import.c:65:import_set_state_nolock()) ffff91eb0a5ad000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788839413.440391:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91eb33773370) has no exports 00000020:00000080:3.0:1788839413.441182:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb37d62800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839413.441242:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb40429000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839413.441264:0:12628:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb37d65800 for lustre-MDT0000 00000020:00000080:3.0:1788839413.441268:0:12628:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb4042b800 for lustre-MDT0000 00000100:00100000:3.0:1788839413.441353:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747161472:0@lo:9:umount.0 00000100:00100000:3.0:1788839413.441423:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839413.441454:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747161600:0@lo:9:umount.0 00000100:00100000:3.0:1788839413.442728:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839413.442783:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839413.443212:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747161472 00000100:00100000:3.0:1788839413.443221:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747161472 00000100:00100000:3.0:1788839413.443299:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747161600 00000100:00100000:3.0:1788839413.443303:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747161600 00000100:00100000:3.0:1788839413.443342:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788839413.443355:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875733747161472:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788839413.443394:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fb35 00000100:00080000:3.0:1788839413.443405:0:6696:0:(import.c:65:import_set_state_nolock()) ffff91eb36e80000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839413.443445:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788839413.445597:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1875733747161472:12345-0@lo:9:umount.0 Request processed in 2236us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839413.445611:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788839413.445643:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839413.445654:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875733747161600:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788839413.445682:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fc0e 00000100:00080000:3.0:1788839413.445693:0:6696:0:(import.c:65:import_set_state_nolock()) ffff91eb408c4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839413.445733:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788839413.446023:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1875733747161600:12345-0@lo:9:umount.0 Request processed in 373us (3299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839413.446031:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788839413.446082:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839413.446087:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839413.446106:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839413.446112:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788839413.448601:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb37138000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788839413.448660:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788839413.448730:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839413.448739:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747161472:0@lo:9:umount.0 00000100:00080000:0.0:1788839413.448757:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb0a5ad000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788839413.448775:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788839413.448777:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839413.448780:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747161600:0@lo:9:umount.0 00000020:00080000:3.0:1788839413.454494:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91eb33773370) has no exports 00000020:00000080:3.0:1788839413.520241:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f9ec 00000020:00000080:3.0:1788839413.520258:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb3bf5e000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788839413.520313:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788839413.520405:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839413.520417:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788839413.520423:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff91eb10204d28) has no exports 00000020:00000080:2.0:1788839413.521723:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f9e5 00000020:00000080:2.0:1788839413.521736:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb41941800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788839413.546312:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3bf5e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788839413.546347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb41941800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788839413.546823:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839413.546838:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788839413.546845:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb41944800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788839413.546848:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb41944800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788839413.546853:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788839413.547652:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb419568a0 - data ffff91eb3789a5e8/ffff91eb40622800 00000020:01000000:2.0:1788839413.547857:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb031374e0 - data ffff91eb2e8640d8/ffff91eb10282400 00000001:00000004:0.0:1788839413.563367:0:12970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788839413.681953:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788839413.681973:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788839413.681998:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788839413.682001:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788839413.687145:0:7129:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788839413.687163:0:7129:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788839413.687174:0:7129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788839413.688849:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788839413.688856:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788839413.688869:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788839413.688872:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788839413.691428:0:8106:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788839413.691439:0:8106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788839413.691458:0:8106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788839413.734418:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f9b4 00000020:00000080:1.0:1788839413.734431:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb3377b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788839413.735866:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f9c9 00000020:00000080:1.0:1788839413.735875:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb3377a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839413.735927:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3377b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788839413.736005:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788839413.736011:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839413.736020:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788839413.736025:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff91eb33770000) has no exports 00000004:01000000:1.0:1788839413.736209:0:12970:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788839413.736219:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fc07 00000020:00000080:1.0:1788839413.736224:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb3c8f1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839413.736301:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3377a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788839413.736350:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788839413.736354:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839413.736361:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788839413.736364:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff91eb0f904d28) has no exports 00000020:00000080:1.0:1788839413.736371:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fc00 00000020:00000080:1.0:1788839413.736383:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb0a5ab000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839413.736403:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3c8f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788839413.736944:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788839413.736951:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788839413.736956:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788839413.736970:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788839413.736972:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839413.737009:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb0a5ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788839413.737404:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839413.737414:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839413.737426:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fb20 00000020:00000080:1.0:1788839413.737432:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb373f7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839413.737479:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb0a5ad000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788839413.737485:0:37:0:(genops.c:885:class_export_put()) final put ffff91eb0a5af000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839413.737487:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb0a5af000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788839413.737492:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788839413.737677:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788839413.737682:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839413.737687:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788839413.737698:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff91eb0f9019b8) has no exports 00000020:00000080:1.0:1788839413.737703:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fb19 00000020:00000080:1.0:1788839413.737707:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb4042c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839413.737772:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb373f7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788839413.738217:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788839413.738221:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788839413.738225:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788839413.738230:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788839413.738232:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839413.738305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb4042c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788839413.738382:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839413.738387:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839413.738420:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839413.738423:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839413.738426:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb1e4de800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788839413.738429:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb1e4de800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788839413.738434:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839413.739190:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f9d0 00000020:00000080:1.0:1788839413.739199:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb3377c800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788839413.739300:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb37138000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788839413.739309:0:37:0:(genops.c:885:class_export_put()) final put ffff91eb373f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839413.739311:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb373f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788839413.739320:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788839413.739475:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788839413.739492:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839413.739501:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788839413.739504:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff91eb337719b8) has no exports 00000020:00000080:1.0:1788839413.739532:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839413.739537:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788839413.739541:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f9d7 00000020:00000080:1.0:1788839413.739556:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb33778800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839413.739618:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3377c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788839413.739623:0:37:0:(genops.c:885:class_export_put()) final put ffff91eb3377b800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788839413.739625:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3377b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788839413.739629:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788839413.739884:0:12970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eb02d49000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788839413.739889:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb02d49000 3 00000020:01000004:1.0:1788839413.739892:0:12970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eb02d49000 from lustre-MDT0000 00000020:00000080:1.0:1788839413.739913:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839413.739917:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788839413.739920:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb3377d800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788839413.739922:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3377d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788839413.739930:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788839413.739979:0:12970:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788839413.739983:0:12970:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788839413.739986:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788839413.739989:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839413.739992:0:12970:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839413.739999:0:12970:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff91eb106c8000 2841848a-c637-485f-b8f2-edd7dddc336d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839413.740005:0:12970:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff91eb102019b8) has exports, disconnecting them 00000020:00080000:1.0:1788839413.740009:0:12970:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91eb106c8000), last request at 1788839174 00000020:00000080:1.0:1788839413.740027:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f975 00000020:00010000:1.0:1788839413.740032:0:12970:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eb106c8000: total 1 00000100:00080000:1.0:1788839413.740043:0:12970:0:(import.c:65:import_set_state_nolock()) ffff91eb106c8800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788839413.740076:0:12970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eb106c8000): rc 0 00000020:00080000:1.0:1788839413.740080:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff91eb102019b8) has no exports 00000020:00010000:3.0:1788839413.740083:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eb106c8000: total 1 00010000:00010000:3.0:1788839413.740114:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eb106c8000, canceled 0 locks, left on hash table 8. 00000100:00100000:1.0:1788839413.740141:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff91eb107b6400:5836] 0 exiting: rc = 1 00010000:00010000:3.0:1788839413.740152:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20965400/0x4b63896d6363fa8d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fa86 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740187:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14528e00/0x4b63896d6363fccb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fcc4 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740197:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14528000/0x4b63896d6363fc77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fc70 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740207:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c7400/0x4b63896d6363fc85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fc7e expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740216:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20965800/0x4b63896d6363fca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fc9a expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740225:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb14529e00/0x4b63896d6363fc93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fc8c expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09eba000/0x4b63896d6363febc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363feb5 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740250:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09ebb400/0x4b63896d6363feca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b63896d6363fec3 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839413.740261:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eb106c8000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788839413.740273:0:5831:0:(genops.c:885:class_export_put()) final put ffff91eb106c8000/2841848a-c637-485f-b8f2-edd7dddc336d 00000020:00000080:2.0:1788839413.740344:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb33778800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788839413.740640:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839413.740643:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839413.740645:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788839413.740658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb106c8000/2841848a-c637-485f-b8f2-edd7dddc336d for MGS 00000100:00100000:3.0:1788839413.740672:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91eb10696000:5838] 2 exiting: rc = 0 00000100:00100000:0.0:1788839413.740818:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff91eb0f858600:5837] 1 exiting: rc = 0 00000020:00000080:2.0:1788839413.740826:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb106c8800 for MGS 00000100:00100000:1.0:1788839413.740876:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740883:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740890:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740903:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740910:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740915:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740921:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740928:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740933:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740939:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740944:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740950:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740955:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740975:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740981:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740986:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740991:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.740997:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741002:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741007:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741012:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741019:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741025:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741031:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741142:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741150:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741155:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741161:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741168:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741174:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741180:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741186:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741191:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741196:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741201:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741207:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741212:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741219:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741231:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741237:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741242:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741247:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741252:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741258:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741263:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741269:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741275:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741281:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741286:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741296:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741303:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741337:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741343:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741348:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741353:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741358:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741362:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741368:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741373:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741378:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741383:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741388:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741394:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.741399:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788839413.742004:0:12970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788839413.742009:0:12970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788839413.744185:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb02f92a80 - data ffff91eb379a4e58/ffff91eb36fd2000 00000020:01000000:1.0:1788839413.744322:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb0a0ee3c0 - data ffff91eb24706510/ffff91eb0f91bc00 00000020:00000080:1.0:1788839413.744985:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f959 00000020:00000080:1.0:1788839413.744993:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb1020f000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788839413.745007:0:12970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eb02d49000 from MGS, refs=2 00000020:01000004:1.0:1788839413.745011:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb02d49000 2 00000020:01000004:1.0:1788839413.745025:0:12970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eb02d49000 from MGS 00000020:00000080:1.0:1788839413.745075:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839413.745083:0:12970:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788839413.745086:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb02d4f800/MGS 00000020:00000080:1.0:1788839413.745088:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb02d4f800/MGS for MGS 00000020:01000000:1.0:1788839413.745095:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788839413.745156:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788839413.745160:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839413.745166:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839413.745173:0:12970:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91eb4194b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839413.745179:0:12970:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff91eb10200000) has exports, disconnecting them 00000020:00080000:1.0:1788839413.745184:0:12970:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91eb4194b800), last request at 1788839175 00000020:00000080:1.0:1788839413.745187:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fa24 00000020:00080000:1.0:1788839413.745198:0:12970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eb4194b800): rc 0 00000020:00000080:1.0:1788839413.745202:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb4194b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788839413.745343:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb1020f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788839413.745351:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb4194b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788839413.747174:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788839413.747183:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839413.747201:0:12970:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839413.747209:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839413.747406:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839413.747415:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788839413.747428:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb02d49000 1 00000020:00000080:2.0:1788839413.747435:0:12970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f94b 00000020:00000080:2.0:1788839413.747443:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb02d4b000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788839413.747449:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788839413.747454:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839413.747458:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788839413.747461:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff91eb09e0cd28) has no exports 00000020:00000080:3.0:1788839413.749863:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb331bb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788839413.749880:0:37:0:(genops.c:885:class_export_put()) final put ffff91eb4194d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788839413.749884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb4194d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788839413.749892:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788839413.749952:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb02d4b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788839413.800176:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839413.800192:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788839413.800198:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb02d4e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839413.800203:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb02d4e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788839413.800210:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788839413.800405:0:12970:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91eb02d49800 00000020:01000000:2.0:1788839413.800429:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788839413.800432:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839413.800437:0:12970:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788839413.800441:0:12970:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff91eb0f900000) has no exports 00000100:00100000:1.0:1788839413.800783:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff91eb0f914a00:5844] 2 exiting: rc = 0 00000100:00100000:1.0:1788839413.800882:0:8483:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff91eb3354c800:8483] 3 exiting: rc = 0 00000100:00100000:0.0:1788839413.800982:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91eb0f8f3600:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1788839413.801558:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91eb0f8f3c00:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1788839413.801715:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801724:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801730:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801736:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801742:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801747:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801753:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801758:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801764:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801770:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801775:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801781:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801797:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801802:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801807:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801812:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801817:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801823:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801829:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801835:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801840:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801845:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801851:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801856:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801861:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801867:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801873:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801878:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801883:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801889:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801894:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801899:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801904:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801909:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801915:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801921:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801927:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801932:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801937:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801942:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801947:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801952:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801957:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801972:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801979:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801984:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.801990:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802001:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802006:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802012:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802018:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802024:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802037:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802043:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802118:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802134:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802140:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802146:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802151:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802156:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802162:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802741:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802750:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.802756:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.813834:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91eb0f917e00:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1788839413.814016:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91eb0f915a00:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1788839413.814756:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814765:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814771:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814778:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814783:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814789:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814795:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814801:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814806:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814812:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814817:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814824:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814830:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814836:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814842:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814847:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814853:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814871:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814876:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814882:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814888:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814893:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814913:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814919:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814924:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814929:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814935:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814940:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814945:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814950:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814955:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814970:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814976:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814982:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814988:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.814995:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815000:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815006:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815011:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815017:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815022:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815037:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815043:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815067:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815073:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815079:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815084:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815089:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815094:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815099:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815105:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815110:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815132:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815138:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815143:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815149:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815156:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815161:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815333:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815342:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815347:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815352:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815358:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.815363:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.816327:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91eb2de67c00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788839413.817289:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff91eb2dd89e00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1788839413.817938:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.817948:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.817955:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.817972:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.817978:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.817984:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818007:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818015:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818020:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818281:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818290:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818295:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818301:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818306:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818312:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818319:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818325:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818332:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818354:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818361:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818367:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818373:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818457:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818466:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818471:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818477:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818483:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818488:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818494:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818500:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818519:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818526:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818532:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818538:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818545:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818550:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818555:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818562:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818567:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818572:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818577:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818583:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818603:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818610:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818616:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818621:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818627:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818632:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818637:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818642:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818647:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818652:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818658:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818662:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818680:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818687:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818692:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818703:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818709:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818715:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818720:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818726:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818732:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.818738:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.830199:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91eb0f8d4000:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1788839413.830792:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91eb0f8d5a00:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1788839413.830934:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830942:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830948:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830953:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830958:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830973:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830977:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830982:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830988:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830993:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.830998:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831004:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831009:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831014:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831019:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831024:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831029:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831034:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831040:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831046:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831275:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831282:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831287:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831292:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831297:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831303:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831309:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831314:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831332:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831337:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831343:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831348:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831353:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831359:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831365:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831370:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831375:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831380:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831385:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831461:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831469:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831475:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831482:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831494:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831499:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831505:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831510:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831516:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831522:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831527:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831533:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831538:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831543:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831549:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831554:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831559:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831564:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831569:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831575:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831580:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831586:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831591:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831597:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.831611:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.832529:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91eb0f8cfc00:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1788839413.832676:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91eb0f8cf800:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1788839413.832952:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.832958:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.832974:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.832979:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.832984:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.832989:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.832994:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.832999:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833004:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833009:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833015:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833020:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833025:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833030:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833035:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833040:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833046:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833267:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833274:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833278:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833283:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833288:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833293:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833298:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833302:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833307:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833312:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833316:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833321:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833326:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833330:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833335:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833340:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833344:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833362:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833367:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833371:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833376:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833381:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833385:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833459:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833467:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833472:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833477:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833483:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833489:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833495:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833500:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833505:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833510:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833516:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833522:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833527:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833531:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833536:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833541:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833546:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833551:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833556:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833560:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833565:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833570:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833574:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839413.833580:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.834873:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91eb0f8cfa00:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1788839413.835039:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91eb0f8ce000:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1788839413.835134:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835142:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835147:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835151:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835157:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835162:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835177:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835183:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835189:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835207:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835211:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835216:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835221:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835227:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835232:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835237:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835243:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835247:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835253:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835258:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835263:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835269:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835274:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835279:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835284:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835289:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835294:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835300:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835304:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835309:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835314:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835319:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835324:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835329:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835333:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835338:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835343:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835348:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835353:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835357:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835362:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835368:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835373:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835377:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835389:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835407:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835412:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835417:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835422:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835427:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835433:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835439:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835443:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835448:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835453:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835458:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835462:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835467:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835473:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835478:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835482:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835487:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835492:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835497:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.835950:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91eb02ed0000:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1788839413.836161:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91eb02ed1600:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1788839413.836302:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91eb02ed0200:5857] 2 exiting: rc = 0 00000100:00100000:1.0:1788839413.836379:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836387:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836392:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836398:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836404:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836409:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836415:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836420:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836427:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836432:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836438:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836444:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836458:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836463:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836468:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836475:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836480:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836485:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836493:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836500:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836517:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836525:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836530:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836535:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836540:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836545:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836551:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836557:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836562:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836569:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836574:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836580:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836586:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836592:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836598:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836604:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836609:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836614:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836620:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836625:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836630:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836636:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836642:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836647:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836667:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836674:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836679:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836691:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836696:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836701:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836707:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836712:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836718:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836724:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836729:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836734:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836740:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836745:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836751:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836757:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836762:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836768:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836774:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839413.836786:0:12970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788839413.844551:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839413.844565:0:12970:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788839413.844571:0:12970:0:(genops.c:885:class_export_put()) final put ffff91eb106c7000/MDS_uuid 00000020:00000080:1.0:1788839413.844576:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb106c7000/MDS_uuid for MDS 00000020:01000000:1.0:1788839413.844582:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788839413.844742:0:12970:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788839414.077436:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747161856:0@lo:400:kworker.0 00000100:00100000:1.0:1788839414.077557:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747161728:0@lo:400:kworker.0 00000400:00000100:1.0:1788839414.077611:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875733747161728 offset 0 length 224: 4 00000400:00000100:2.0:1788839414.077734:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875733747161856 offset 0 length 224: 4 00010000:00010000:3.0:1788839414.143222:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839415.165216:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788839415.772252:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839415.772261:0:7651:0:(genops.c:885:class_export_put()) final put ffff91eb03063000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788839415.772312:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb03063000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788839415.772363:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb408c4800 for lustre-OST0001 00010000:00010000:3.0:1788839416.189559:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788839416.752426:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788839416.752436:0:6721:0:(genops.c:885:class_export_put()) final put ffff91eb36e87000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788839416.752473:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb36e87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788839416.752524:0:12628:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb36e80000 for lustre-OST0000 00000020:01000004:3.0:1788839416.884933:0:13122:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788839416.899265:0:13122:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788839416.899304:0:13122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839416.899315:0:13122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839416.899321:0:13122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839416.899326:0:13122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839416.899346:0:13122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788839416.899350:0:13122:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788839416.899368:0:13122:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788839416.899376:0:13122:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eb330f4a80 x1875733747161728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839416.899391:0:13122:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788839416.899406:0:13122:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788839416.899425:0:13122:0:(import.c:65:import_set_state_nolock()) ffff91eb373f7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788839416.899478:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747161728:0@lo:400:kworker.0 00010000:00010000:0.0:1788839416.899598:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839416.899608:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839416.899614:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965c00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839416.899617:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839416.899624:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839416.899629:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839416.899634:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839416.899637:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788839416.899639:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788839416.899664:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839416.899670:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839416.899699:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839416.899706:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20965c00/0x4b63896d6363fc8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b63896d6363fc93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839416.899718:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839416.899720:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839416.899722:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839416.899734:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875733747161984:0@lo:39:umount.0 00000400:00000100:0.0:1788839416.899776:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875733747161984 offset 0 length 224: 4 00000100:00100000:3.0:1788839416.899867:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747162112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839416.899919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839416.900111:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747162112 00000100:00100000:0.0:1788839416.900118:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747162112 00000100:00100000:0.0:1788839416.900151:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839416.900157:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875733747162112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788839416.900162:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839416 with bad export cookie 5432336678450887029 00000100:00100000:0.0:1788839416.903892:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875733747162112:12345-0@lo:103:ldlm_bl.0 Request processed in 3726us (3965us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788839416.904669:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788839416.904715:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788839416.904719:0:3311:0:(import.c:65:import_set_state_nolock()) ffff91eb102ea000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788839416.904722:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788839416.908079:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.109@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788839416.908085:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788839416.908094:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eb0f8f9500 x1875733747162112/t0(0) o103->MGC192.168.201.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839432 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788839416.908108:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788839416.908112:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788839416.908113:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788839416.908116:0:3311:0:(import.c:65:import_set_state_nolock()) ffff91eb102ea000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839416.908120:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 157 00000100:00080000:0.0:1788839416.908127:0:3311:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import ffff91eb102ea000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839416.908156:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb0f8f9c00 x1875733747162240/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839416.908183:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2841848a-c637-485f-b8f2-edd7dddc336d:3311:1875733747162112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839416.908215:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2841848a-c637-485f-b8f2-edd7dddc336d:3310:1875733747162240:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788839416.908254:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875733747162240 offset 0 length 520: 4 00010000:00010000:3.0:1788839417.213354:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839418.237489:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839419.197179:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839419.197190:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839419.197380:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747162368:0@lo:400:kworker.0 00000400:00000100:3.0:1788839419.197438:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875733747162368 offset 0 length 224: 4 00010000:00010000:3.0:1788839419.261219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839420.289240:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839421.309232:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839422.205322:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839422.205334:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788839422.205456:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747162496:0@lo:400:kworker.0 00000400:00000100:1.0:1788839422.205530:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875733747162496 offset 0 length 224: 4 00010000:00010000:0.0:1788839422.333313:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839423.357380:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839424.381256:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839425.405243:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839426.365182:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839416/real 1788839416] req@ffff91eb0f8f9c00 x1875733747162240/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839426.365227:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91eb0f8f9c00 x1875733747162240/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839426.365240:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839416/real 1788839416] req@ffff91eb37df1f80 x1875733747161984/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839426.365263:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91eb37df1f80 x1875733747161984/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788839426.365281:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb102ea000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839426.365300:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788839426.365305:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2841848a-c637-485f-b8f2-edd7dddc336d:3310:1875733747162240:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788839426.365311:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb373f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788839426.365323:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875733747161984:0@lo:39:umount.0 00000100:00080000:2.0:1788839426.365548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839426.365554:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788839426.365557:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eb102ea000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839426.365562:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1788839426.365567:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.109@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788839426.365574:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import ffff91eb102ea000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1788839426.365612:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb330f5180 x1875733747162624/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839426.365716:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839426.365764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747162752:0@lo:400:kworker.0 00000400:00000100:1.0:1788839426.365818:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875733747162752 offset 0 length 224: 4 00000100:00100000:1.0:1788839426.365895:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2841848a-c637-485f-b8f2-edd7dddc336d:3310:1875733747162624:0@lo:250:kworker.0 00000400:00000100:1.0:1788839426.365916:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875733747162624 offset 0 length 520: 4 00000100:00080000:3.0:1788839426.366399:0:13122:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788839426.366404:0:13122:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788839426.366410:0:13122:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788839426.367523:0:13122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367538:0:13122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367545:0:13122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367553:0:13122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367571:0:13122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839426.367578:0:13122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367599:0:13122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367605:0:13122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367611:0:13122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839426.367637:0:13122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788839426.367642:0:13122:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788839426.367666:0:13122:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788839426.367672:0:13122:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788839426.367676:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839426.367682:0:13122:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788839426.367687:0:13122:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff91eb10203370) has no exports 00000020:00080000:3.0:1788839426.367712:0:13122:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff91eb10203370) has no exports 00010000:00010000:0.0:1788839426.367897:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839426.367905:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.367913:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14528600 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839426.367917:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.367935:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839426.367951:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839426.367956:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839426.367958:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788839426.367960:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788839426.367975:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eb102ea000 00010000:00010000:0.0:1788839426.367979:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.367986:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14528600/0x4b63896d6363fc9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fca1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.368002:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839426.368005:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.368012:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba600 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839426.368015:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.368021:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839426.368027:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839426.368032:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788839426.368034:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788839426.368041:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788839426.368086:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eb102ea000 00010000:00010000:0.0:1788839426.368090:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.368097:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb09eba600/0x4b63896d6363fec3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363feca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839426.368109:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839426.368111:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839426.368113:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839426.368417:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788839426.370887:0:13122:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb061e4600 - data ffff91ea015eb438/ffff91eb3314c800 00000020:01000000:3.0:1788839426.371177:0:13122:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb02ff1600 - data ffff91eb37833948/ffff91eb36e89800 00100000:10000000:3.0:1788839426.381205:0:13122:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788839426.419128:0:13122:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363faa9 00000020:00000080:1.0:1788839426.419139:0:13122:0:(genops.c:885:class_export_put()) final put ffff91eb36e85800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788839426.419156:0:13122:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eb3bf58000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788839426.419159:0:13122:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb3bf58000 2 00000020:01000004:1.0:1788839426.419162:0:13122:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eb3bf58000 from lustre-OST0000 00000020:00000080:1.0:1788839426.419189:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839426.419199:0:13122:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788839426.419202:0:13122:0:(genops.c:885:class_export_put()) final put ffff91eb36e84800/lustre-OST0000_UUID 00000020:00000080:1.0:1788839426.419204:0:13122:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb36e84800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788839426.419216:0:13122:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788839426.419263:0:13122:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788839426.419267:0:13122:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788839426.419271:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839426.419275:0:13122:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839426.419283:0:13122:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91eb373f1800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839426.419289:0:13122:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff91eb0f903370) has exports, disconnecting them 00000020:00080000:1.0:1788839426.419293:0:13122:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91eb373f1800), last request at 1788839191 00000020:00000080:1.0:1788839426.419297:0:13122:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fad3 00000020:00080000:1.0:1788839426.419306:0:13122:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eb373f1800): rc 0 00000020:00000080:1.0:1788839426.419310:0:13122:0:(genops.c:885:class_export_put()) final put ffff91eb373f1800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788839426.420090:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb36e85800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788839426.420100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb373f1800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788839426.436234:0:13122:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788839426.436244:0:13122:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839426.436248:0:13122:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788839426.436268:0:13122:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788839426.436551:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839426.436560:0:13122:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788839426.436572:0:13122:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb3bf58000 1 00000020:00000080:1.0:1788839426.436578:0:13122:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fa63 00000020:00000080:1.0:1788839426.436587:0:13122:0:(genops.c:885:class_export_put()) final put ffff91eb03064000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788839426.436823:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb373f7000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788839426.436831:0:36:0:(genops.c:885:class_export_put()) final put ffff91eb3713b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788839426.436834:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3713b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788839426.436846:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788839426.437652:0:13122:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788839426.437660:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839426.437665:0:13122:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788839426.437670:0:13122:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff91eb09e0b370) has no exports 00000020:00000080:2.0:1788839426.439473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb03064000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788839426.455525:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839426.455543:0:13122:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788839426.455551:0:13122:0:(genops.c:885:class_export_put()) final put ffff91eb3bf5c800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788839426.455556:0:13122:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3bf5c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788839426.455571:0:13122:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788839426.455701:0:13122:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91eb3bf5f800 00000020:02000400:0.0:1788839426.455780:0:13122:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788839426.523360:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839427.582231:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839428.606150:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788839429.235600:0:13275:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788839429.273448:0:13275:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788839429.273528:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839429.273611:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839429.273619:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839429.273749:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839429.273836:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788839429.273843:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788839429.273866:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839429.273879:0:13275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eb330f7b80 x1875733747161856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839429.273906:0:13275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eb330f4a80 x1875733747162368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839435 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839429.273925:0:13275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eb330f4700 x1875733747162496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839429.273939:0:13275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eb330f6d80 x1875733747162752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839429.273946:0:13275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788839429.273953:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788839429.273982:0:13275:0:(import.c:65:import_set_state_nolock()) ffff91eb02e9a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788839429.274073:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747162752:0@lo:400:kworker.0 00000100:00100000:0.0:1788839429.274083:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747162496:0@lo:400:kworker.0 00000100:00100000:0.0:1788839429.274128:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875733747162880:0@lo:39:umount.0 00000400:00000100:0.0:1788839429.274179:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875733747162880 offset 0 length 224: 4 00000100:00100000:2.0:1788839429.274336:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747161856:0@lo:400:kworker.0 00000100:00100000:3.0:1788839429.274478:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747162368:0@lo:400:kworker.0 00010000:00010000:1.0:1788839429.274781:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839429.274790:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839429.274799:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964200 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:1.0:1788839429.274803:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839429.274812:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839429.274819:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839429.274825:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788839429.274828:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788839429.274831:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788839429.274845:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eb102ea000 00010000:00010000:1.0:1788839429.274849:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839429.274869:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20964200/0x4b63896d6363fc70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fc77 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839429.274881:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839429.274883:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839429.274885:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839429.629284:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839430.661321:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839431.485809:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839431.485820:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788839431.681199:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839432.701303:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839433.728790:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839434.749525:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839435.773835:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839436.606829:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839436.606838:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2841848a-c637-485f-b8f2-edd7dddc336d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788839436.797536:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839437.821777:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839438.845340:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839439.486238:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839429/real 1788839429] req@ffff91eb0f8f9c00 x1875733747162880/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839439 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839439.486272:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91eb0f8f9c00 x1875733747162880/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839439 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788839439.486290:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb02e9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788839439.486300:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875733747162880:0@lo:39:umount.0 00000100:00080000:0.0:1788839439.486667:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839439.486673:0:13275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788839439.486678:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788839439.487540:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487554:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487575:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487583:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487609:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839439.487617:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487624:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487630:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487637:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839439.487666:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788839439.487671:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788839439.487695:0:13275:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788839439.487700:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788839439.487704:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839439.487709:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788839439.487714:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff91eb3772cd28) has no exports 00010000:00010000:2.0:1788839439.487732:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1788839439.487741:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff91eb3772cd28) has no exports 00010000:00010000:2.0:1788839439.488529:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488539:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb14528a00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:2.0:1788839439.488543:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488553:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839439.488560:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839439.488566:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788839439.488569:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788839439.488572:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788839439.488588:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eb102ea000 00010000:00010000:2.0:1788839439.488592:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488599:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb14528a00/0x4b63896d6363fc7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fc85 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488614:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839439.488618:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488624:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7a00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:2.0:1788839439.488627:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488645:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839439.488665:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839439.488671:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788839439.488673:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788839439.488675:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788839439.488682:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eb102ea000 00010000:00010000:2.0:1788839439.488685:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488692:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb102c7a00/0x4b63896d6363feb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363febc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839439.488706:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839439.488707:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839439.488710:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839439.488775:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788839439.489369:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb061e4360 - data ffff91eb2476c510/ffff91eb05b91c00 00000020:01000000:0.0:1788839439.494418:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eb409d5420 - data ffff91eb24759360/ffff91ea01e47400 00100000:10000000:0.0:1788839439.503384:0:13275:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788839439.559125:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fb74 00000020:00000080:1.0:1788839439.559148:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb3c8f2000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788839439.559177:0:13275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eb02e9b800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788839439.559181:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb02e9b800 2 00000020:01000004:1.0:1788839439.559184:0:13275:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eb02e9b800 from lustre-OST0001 00000020:00000080:1.0:1788839439.559207:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839439.559219:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788839439.559222:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb3c8f7800/lustre-OST0001_UUID 00000020:00000080:1.0:1788839439.559226:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3c8f7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788839439.559234:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788839439.559353:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2841848a-c637-485f-b8f2-edd7dddc336d->MGS 00010000:00010000:1.0:1788839439.559369:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fa8d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839439.559382:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fa8d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839439.559389:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788839439.559392:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788839439.559395:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788839439.559410:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eb102ea000 00010000:00010000:1.0:1788839439.559414:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6f800/0x4b63896d6363fa86 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fa8d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839439.559428:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b63896d6363fccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839439.559434:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b63896d6363fccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839439.559439:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788839439.559441:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788839439.559443:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788839439.559462:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eb102ea000 00010000:00010000:1.0:1788839439.559464:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d6363fcc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b63896d6363fccb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788839439.559481:0:13275:0:(import.c:65:import_set_state_nolock()) ffff91eb102ea000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788839439.559484:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788839439.559486:0:13275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788839439.559488:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788839439.559491:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788839439.559514:0:13275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eb330f5180 x1875733747162624/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788839441 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788839439.559532:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788839439.559535:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788839439.559567:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2841848a-c637-485f-b8f2-edd7dddc336d:3310:1875733747162624:0@lo:250:kworker.0 10000000:01000000:1.0:1788839439.559602:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788839439.559608:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363f967 00000020:00000080:1.0:1788839439.559613:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb106c2000/2841848a-c637-485f-b8f2-edd7dddc336d 00000020:01000000:1.0:1788839439.559618:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.109@tcp (flags='') 00000020:00000080:1.0:1788839439.559622:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839439.559626:0:13275:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.109@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788839439.559629:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff91eb09e08000) has no exports 10000000:01000000:2.0:1788839439.560178:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1788839439.560229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb3c8f2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788839439.560244:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb106c2000/2841848a-c637-485f-b8f2-edd7dddc336d for MGC192.168.201.109@tcp 10000000:01000000:1.0:1788839439.560381:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.109@tcp: client import never connected 00000100:00080000:1.0:1788839439.560385:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788839439.560387:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788839439.560389:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788839439.560391:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788839439.560436:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839439.560441:0:13275:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.109@tcp (uuid 2841848a-c637-485f-b8f2-edd7dddc336d) 00000020:01000000:1.0:1788839439.560446:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788839439.560451:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839439.560454:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839439.560459:0:13275:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91eb02e98800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839439.560473:0:13275:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff91eb33774d28) has exports, disconnecting them 00000020:00080000:1.0:1788839439.560477:0:13275:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91eb02e98800), last request at 1788839210 00000020:00000080:1.0:1788839439.560481:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fb9e 00000020:00080000:1.0:1788839439.560492:0:13275:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eb02e98800): rc 0 00000020:00000080:1.0:1788839439.560495:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb02e98800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788839439.560972:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb102ea000 for MGC192.168.201.109@tcp 00000020:00000080:2.0:1788839439.560981:0:37:0:(genops.c:885:class_export_put()) final put ffff91eb102e8000/2841848a-c637-485f-b8f2-edd7dddc336d 00000020:00000080:2.0:1788839439.560983:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb102e8000/2841848a-c637-485f-b8f2-edd7dddc336d for MGC192.168.201.109@tcp 00000020:01000000:2.0:1788839439.560990:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.109@tcp (2841848a-c637-485f-b8f2-edd7dddc336d) 00000020:00000080:2.0:1788839439.563358:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb02e98800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788839439.564206:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788839439.564222:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839439.564227:0:13275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839439.564233:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788839439.564306:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788839439.564423:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1788839439.564530:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91eb09f1de00:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1788839439.564652:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91eb09f1ce00:5827] 1 exiting: rc = 0 00000020:00000080:3.0:1788839439.564698:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eb02e9a800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1788839439.564982:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.565375:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91eb05072c00:5830] 2 exiting: rc = 0 00000100:00100000:3.0:1788839439.565442:0:6711:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91eb370f1600:6711] 3 exiting: rc = 0 00000100:00100000:2.0:1788839439.565668:0:8458:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff91eb1062a600:8458] 4 exiting: rc = 0 00000100:00100000:2.0:1788839439.565727:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91eb09f1c400:5828] 0 exiting: rc = 1 00000100:00100000:1.0:1788839439.604222:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91eb05073800:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1788839439.604782:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604791:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604797:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604804:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604810:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604815:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604821:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604826:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604832:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604838:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604844:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604861:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604868:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604874:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604889:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604897:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604903:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604909:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604914:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604920:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604926:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604932:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604937:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604942:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604979:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604985:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604991:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.604997:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605003:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605010:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605017:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605025:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605031:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605036:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605042:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605081:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605088:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605094:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605100:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605106:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605112:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605117:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605122:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605128:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605133:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605139:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605145:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605150:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605376:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605386:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605392:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605398:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605404:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605410:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605415:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605423:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605429:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605435:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605440:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605455:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605460:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605466:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605471:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.605476:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788839439.608260:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839439.608341:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788839439.608348:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb330de000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788839439.608366:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb330de000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788839439.608377:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788839439.608431:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb02e9b800 1 00000020:00000080:3.0:1788839439.608440:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b63896d6363fb43 00000020:00000080:3.0:1788839439.608449:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb37d60000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788839439.608640:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788839439.608646:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839439.608651:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788839439.608655:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff91eb3360b370) has no exports 00000020:00000080:2.0:1788839439.610334:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb37d60000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788839439.654897:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839439.654919:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788839439.654925:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb02e9b000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788839439.654932:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb02e9b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788839439.654944:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788839439.655268:0:13275:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91eb02e9d800 00000020:01000000:3.0:1788839439.655292:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788839439.655297:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839439.655302:0:13275:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788839439.655306:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff91eb09e099b8) has no exports 00000020:00000080:3.0:1788839439.655328:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839439.655333:0:13275:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788839439.655336:0:13275:0:(genops.c:885:class_export_put()) final put ffff91eb03061800/OSS_uuid 00000020:00000080:3.0:1788839439.655338:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff91eb03061800/OSS_uuid for OSS 00000020:01000000:3.0:1788839439.655342:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788839439.655411:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91eb0610a400:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1788839439.655518:0:9213:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91eb09e48400:9213] 3 exiting: rc = 0 00000100:00100000:3.0:1788839439.655568:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91eb0a065600:6698] 2 exiting: rc = 0 00000100:00100000:3.0:1788839439.655605:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91eb06401400:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1788839439.655668:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655676:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655682:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655688:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655829:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655835:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655841:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655846:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655851:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655856:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655862:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655867:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655873:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655878:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655885:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655891:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655896:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655902:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655907:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655912:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655917:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655923:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655929:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655934:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655939:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655946:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655951:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655957:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655962:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655968:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655974:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655979:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655983:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655989:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655994:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.655999:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656022:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656030:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656035:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656046:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656076:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656081:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656205:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656210:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656216:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656221:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656226:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656231:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656236:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656241:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656245:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656251:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656256:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656261:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656266:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656272:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656277:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656282:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656286:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656292:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656297:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656303:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656309:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.656314:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1788839439.656851:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788839439.657868:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91eb40532c00:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1788839439.657941:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91eb40532400:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1788839439.658027:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.658034:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.658039:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.658044:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660208:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660228:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660233:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660238:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660242:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660248:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660269:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660275:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660280:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660285:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660291:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660298:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660303:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660308:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660313:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660319:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660325:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660331:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660337:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660343:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660349:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660355:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660360:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660365:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660371:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660376:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660382:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660388:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660393:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660399:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660404:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660409:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660414:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660420:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660425:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660431:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660437:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660443:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660449:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660456:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660461:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660479:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660488:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660494:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660508:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660515:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660520:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660525:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660531:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660536:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660541:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660547:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660552:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660556:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660561:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660566:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660570:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660575:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660581:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.660588:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.665939:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91eb1063e200:6702] 1 exiting: rc = 0 00000100:00100000:3.0:1788839439.666258:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91eb1063e600:6701] 0 exiting: rc = 1 00000100:00100000:1.0:1788839439.667977:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91eb1063f400:6703] 2 exiting: rc = 0 00000100:00100000:3.0:1788839439.668444:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668454:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668461:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668467:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668473:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668480:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668486:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668493:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668498:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668516:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668522:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668528:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668534:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668539:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668546:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668571:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668577:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668601:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668608:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668615:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668620:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668626:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668632:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668638:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668655:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668663:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668668:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668674:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668679:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668685:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668691:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668697:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668702:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668821:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668830:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668838:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668843:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668849:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668855:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668862:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668868:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668891:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668898:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668904:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668910:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668915:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668921:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668928:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668933:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668939:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668952:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668957:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668964:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668970:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668987:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668994:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.668999:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.669004:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.669017:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.669024:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.669030:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.669036:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.669041:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.669046:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839439.684534:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91eb40533a00:6704] 0 exiting: rc = 1 00000100:00100000:2.0:1788839439.684872:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91eb40533000:6705] 1 exiting: rc = 0 00000100:00100000:0.0:1788839439.684969:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.684978:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.684984:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.684990:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.684995:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685002:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685007:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685012:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685018:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685023:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685028:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685033:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685038:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685043:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685076:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685092:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685099:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685104:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685109:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685114:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685120:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685126:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685132:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685144:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685150:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685157:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685162:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685167:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685172:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685191:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685197:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685202:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685208:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685213:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685218:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685223:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685229:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685234:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685239:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685244:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685248:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685253:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685259:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685264:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685270:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685275:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685280:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685285:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685290:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685295:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685301:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685306:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685311:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685316:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685321:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685326:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685331:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685335:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685341:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685346:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685352:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685358:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685364:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.685378:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839439.686559:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91eb3c9a3800:6706] 0 exiting: rc = 1 00000100:00100000:2.0:1788839439.686649:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91eb3c9a3c00:6707] 1 exiting: rc = 0 00000100:00100000:0.0:1788839439.686939:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686948:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686956:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686962:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686968:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686975:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686982:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686987:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.686994:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687001:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687023:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687031:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687037:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687045:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687240:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687250:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687257:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687263:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687270:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687276:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687282:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687288:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687310:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687318:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687325:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687331:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687338:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687345:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687351:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687357:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687365:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687371:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687380:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687390:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687416:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687441:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687448:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687454:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687460:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687467:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687472:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687478:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687485:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687490:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687497:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687519:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687543:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687552:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687559:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687567:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687574:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687580:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687587:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687594:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687600:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687606:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687612:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687618:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687640:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687949:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687956:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687961:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687968:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839439.687975:0:13275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788839439.710823:0:13275:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788839457.094800:0:13891:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788839466.552936:0:14353:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788839466.552941:0:14353:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788839466.553091:0:14353:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91ea02e78800 00000020:01000004:3.0:1788839466.553109:0:14353:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788839466.553119:0:14353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788839466.553134:0:14353:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91eb33774d28) 00000020:00000080:3.0:1788839466.553148:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788839466.600991:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788839466.607785:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788839466.608776:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788839466.608857:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1788839466.608968:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1788839466.609335:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1788839466.609544:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1788839466.609640:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1788839466.609778:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1788839466.611348:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 49: rc = 0 00100000:10000000:1.0:1788839466.614874:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 460: rc = 0 00100000:10000000:1.0:1788839466.614995:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 460: rc = 0 00100000:10000000:1.0:1788839466.615770:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788839466.616199:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:1.0:1788839466.616902:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:1.0:1788839466.617411:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788839466.617729:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788839466.617967:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:1.0:1788839466.618721:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:1.0:1788839466.618991:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788839466.626815:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788839466.627335:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:1.0:1788839466.629758:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788839466.630342:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:1.0:1788839466.638908:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 472: rc = 0 00100000:10000000:2.0:1788839466.661759:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 472: rc = 0 00100000:10000000:2.0:1788839466.662167:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 472: rc = 0 00100000:10000000:2.0:1788839466.662441:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 472: rc = 0 00100000:10000000:2.0:1788839466.662709:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 472: rc = 0 00100000:10000000:3.0:1788839466.662989:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 472: rc = 0 00100000:10000000:2.0:1788839466.664384:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 472: rc = 0 00100000:10000000:2.0:1788839466.665482:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 472: rc = 0 00100000:10000000:2.0:1788839466.665939:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 472: rc = 0 00100000:10000000:2.0:1788839466.667579:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 472: rc = 0 00100000:10000000:2.0:1788839466.667867:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 472: rc = 0 00100000:10000000:2.0:1788839466.668159:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 472: rc = 0 00100000:10000000:2.0:1788839466.668966:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 472: rc = 0 00100000:10000000:2.0:1788839466.669504:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 472: rc = 0 00100000:10000000:2.0:1788839466.669861:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 472: rc = 0 00100000:10000000:2.0:1788839466.670410:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 472: rc = 0 00100000:10000000:2.0:1788839466.670686:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 472: rc = 0 00100000:10000000:2.0:1788839466.670920:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 472: rc = 0 00100000:10000000:2.0:1788839466.672787:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 472: rc = 0 00100000:10000000:2.0:1788839466.673157:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 472: rc = 0 00100000:10000000:2.0:1788839466.675177:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 472: rc = 0 00100000:10000000:2.0:1788839466.675525:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 472: rc = 0 00100000:10000000:2.0:1788839466.675777:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 472: rc = 0 00100000:10000000:2.0:1788839466.678008:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 472: rc = 0 00100000:10000000:2.0:1788839466.678778:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 472: rc = 0 00100000:10000000:2.0:1788839466.679030:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 472: rc = 0 00100000:10000000:2.0:1788839466.682696:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 472: rc = 0 00100000:10000000:2.0:1788839466.683030:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 472: rc = 0 00100000:10000000:2.0:1788839466.683889:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 472: rc = 0 00100000:10000000:2.0:1788839466.684405:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 472: rc = 0 00100000:10000000:2.0:1788839466.685128:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 472: rc = 0 00100000:10000000:2.0:1788839466.685487:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 472: rc = 0 00100000:10000000:2.0:1788839466.687892:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 655: rc = 0 00100000:10000000:2.0:1788839466.688499:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788839466.697661:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 461: rc = 0 00100000:10000000:2.0:1788839466.698046:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788839466.698148:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 461: rc = 0 00100000:10000000:2.0:1788839466.698419:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788839466.698489:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 461: rc = 0 00100000:10000000:2.0:1788839466.699528:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788839466.699627:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 352: rc = 0 00100000:10000000:2.0:1788839466.699818:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788839466.700028:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 352: rc = 0 00100000:10000000:2.0:1788839466.700637:0:14353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788839466.700710:0:14353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 352: rc = 0 00000020:00000080:2.0:1788839466.701168:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788839466.701176:0:14353:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839466.703419:0:14353:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d63640c68 00000020:01000004:3.0:1788839466.703434:0:14353:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788839466.703440:0:14353:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788839466.703448:0:14353:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ea02e78800 from MGS 00000020:01000004:3.0:1788839466.703453:0:14353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788839466.703469:0:14353:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91eb33773370) 00000020:00000080:3.0:1788839466.703481:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788839466.703626:0:14353:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ea02e78800 from MGS, refs=2 00080000:01000000:3.0:1788839466.703632:0:14353:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788839466.703638:0:14353:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d63640c76 00000100:00100000:3.0:1788839466.703790:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788839466.704669:0:14353:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788839466.704677:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788839466.705867:0:14353:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788839466.705877:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788839466.707966:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839466.708507:0:14353:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788839466.708514:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788839466.710187:0:14353:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788839466.710200:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788839466.710921:0:14353:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788839466.710929:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788839466.712875:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839466.712881:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839466.712883:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839466.713854:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839466.713859:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839466.713861:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839466.714898:0:14353:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788839466.718435:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788839466.731980:0:14353:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788839466.731999:0:14353:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788839466.732162:0:14353:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788839466.762207:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788839466.762538:0:14353:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788839466.762684:0:14353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788839466.763419:0:14353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788839466.764353:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839466.768162:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788839466.768174:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788839466.780200:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788839466.780307:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788839466.780995:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788839466.781002:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788839466.781850:0:14367:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788839466.782208:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788839466.782231:0:14353:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.109@tcp' 00000020:01000004:1.0:1788839466.782233:0:14353:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788839466.782266:0:14353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.109@tcp (typ=mgc) 00000020:00000080:1.0:1788839466.782280:0:14353:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.109@tcp (ffff91eb3772cd28) 00000020:00000080:1.0:1788839466.782295:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788839466.782375:0:14353:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb1e4da000@MGC192.168.201.109@tcp: add connection 192.168.201.109@tcp at head 00010000:00010000:1.0:1788839466.782537:0:14353:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.109@tcp-0 is initialized 00000040:01000000:1.0:1788839466.782545:0:14353:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788839466.797196:0:14369:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788839466.797467:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.109@tcp (uuid c7e0041a-0f2b-4d5c-901d-ed02d83b952c) 00000020:00000080:0.0:1788839466.797495:0:14353:0:(genops.c:1385:class_connect()) connect: client c7e0041a-0f2b-4d5c-901d-ed02d83b952c, cookie 0x4b63896d63640c84 00000100:00080000:0.0:1788839466.797508:0:14353:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788839466.797514:0:14353:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import ffff91eb1e4da000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839466.797550:0:14353:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb0f8f9500 x1875733747163008/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839466.797622:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3310:1875733747163008:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788839466.797712:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839466.797908:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163008 00000100:00100000:2.0:1788839466.797916:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163008 00000100:00100000:2.0:1788839466.797956:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839466.797964:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875733747163008:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788839466.797987:0:14364:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c7e0041a-0f2b-4d5c-901d-ed02d83b952c@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1788839466.798012:0:14364:0:(genops.c:1385:class_connect()) connect: client c7e0041a-0f2b-4d5c-901d-ed02d83b952c, cookie 0x4b63896d63640c8b 00000100:00080000:2.0:1788839466.798170:0:14364:0:(import.c:65:import_set_state_nolock()) ffff91eb37c51000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788839466.798430:0:14353:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c7e0041a-0f2b-4d5c-901d-ed02d83b952c->MGS 00000020:01000004:0.0:1788839466.798452:0:14353:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788839466.798458:0:14353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788839466.798473:0:14353:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff91eb0f903370) 00000020:00000080:0.0:1788839466.798484:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788839466.803908:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+5:3310:x1875733747163008:12345-0@lo:250:mount.lustre.0 Request processed in 5930us (6183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839466.803924:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839466.805112:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788839466.805127:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.109@tcp: connect to target with instance 0 00000100:00080000:1.0:1788839466.805146:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788839466.805151:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788839466.805157:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb1e4da000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788839466.805160:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788839466.806386:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788839466.806400:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3310:1875733747163008:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788839466.810991:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839466.811285:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788839466.811292:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788839466.812291:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788839466.812299:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788839466.813789:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788839466.813800:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788839466.814675:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839466.814893:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788839466.814898:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788839466.815933:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788839466.815941:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788839466.892094:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839466.895535:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788839466.895563:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788839466.896774:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788839466.896785:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788839466.897979:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839466.898246:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788839466.898253:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788839466.898795:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788839466.898802:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788839466.899354:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839466.899513:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788839466.899519:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788839466.900841:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788839466.900852:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788839466.901478:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839466.901670:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788839466.901676:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788839466.902293:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788839466.902301:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788839466.935206:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839466.935460:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788839466.935467:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788839466.938615:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788839466.938630:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788839466.939680:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788839466.939690:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788839466.940549:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788839466.940572:0:14353:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788839466.940578:0:14353:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788839466.940714:0:14353:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788839466.940755:0:14353:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788839466.940760:0:14353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788839466.940762:0:14353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788839466.940764:0:14353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839466.940765:0:14353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839466.940767:0:14353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839466.940768:0:14353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839466.940769:0:14353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788839466.940775:0:14353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788839466.940777:0:14353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839466.940778:0:14353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839466.940781:0:14353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788839466.940783:0:14353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839466.940784:0:14353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788839466.940785:0:14353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839466.940786:0:14353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839466.940787:0:14353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839466.940788:0:14353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839466.940789:0:14353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788839466.940790:0:14353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788839466.940791:0:14353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839466.940792:0:14353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839466.940829:0:14353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788839466.940850:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163136:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839466.940924:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839466.940981:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4074ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839466.941102:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163136 00000100:00100000:3.0:1788839466.941111:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163136 00000100:00100000:3.0:1788839466.941157:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839466.941167:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+5:14353:x1875733747163136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788839466.941228:0:14366:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788839466.941232:0:14366:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788839466.941236:0:14366:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788839466.941640:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788839466.941966:0:14366:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788839466.946909:0:14388:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788839466.946916:0:14388:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788839466.946919:0:14388:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788839466.946949:0:14388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788839466.947327:0:14366:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788839466.947338:0:14366:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788839466.958233:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+5:14353:x1875733747163136:12345-0@lo:253:mount.lustre.0 Request processed in 17057us (17299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839466.958250:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839466.958359:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163136:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788839466.958393:0:14353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788839466.958397:0:14353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839466.958399:0:14353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788839466.958400:0:14353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839466.958402:0:14353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839466.958403:0:14353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839466.958404:0:14353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839466.958406:0:14353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839466.958408:0:14353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788839466.958410:0:14353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839466.958411:0:14353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788839466.958430:0:14353:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ea02e78800 from lustre-MDT0000 10000000:01000000:0.0:1788839466.958454:0:14353:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788839466.958458:0:14353:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788839466.958462:0:14353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91eb3772cd28 10000000:01000000:0.0:1788839466.958466:0:14353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788839466.958473:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eb3772cd28 from 1 10000000:01000000:0.0:1788839466.958476:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788839466.958517:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.958529:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.958538:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839466.958557:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839466.958594:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839466.958634:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839466.958699:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163264 00000100:00100000:2.0:1788839466.958706:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163264 00000100:00100000:2.0:1788839466.958751:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839466.958761:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+5:14353:x1875733747163264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839466.958773:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839466.958788:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09ebaa00/0x4b63896d63640ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640c99 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839466.958810:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09ebaa00/0x4b63896d63640ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640c99 expref: 6 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839466.958832:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09ebaa00/0x4b63896d63640ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640c99 expref: 6 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839466.958843:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebaa00, rc 0) 00000100:00100000:2.0:1788839466.958884:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+6:14353:x1875733747163264:12345-0@lo:101:mount.lustre.0 Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839466.958891:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839466.958959:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839466.958973:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.958992:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839466.959077:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839466.959105:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839466.959129:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839466.959189:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163392 00000100:00100000:2.0:1788839466.959193:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163392 00000100:00100000:2.0:1788839466.959221:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839466.959228:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+6:14353:x1875733747163392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839466.959475:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+6:14353:x1875733747163392:12345-0@lo:501:mount.lustre.0 Request processed in 246us (368us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839466.959482:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839466.959562:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163392:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788839466.959588:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788839466.959607:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.959615:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839466.959623:0:14353:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ea02e78800 10000000:01000000:0.0:1788839466.959628:0:14353:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788839466.959631:0:14353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91ea02e78800 10000000:01000000:0.0:1788839466.959633:0:14353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788839466.959636:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91ea02e78800 from 1 10000000:01000000:0.0:1788839466.959638:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788839466.959653:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6800/0x4b63896d63640ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.959660:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c6800/0x4b63896d63640ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.959667:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c6800/0x4b63896d63640ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839466.959685:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839466.959710:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839466.959730:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839466.959797:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163520 00000100:00100000:3.0:1788839466.959802:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163520 00000100:00100000:3.0:1788839466.959839:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839466.959846:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+6:14353:x1875733747163520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839466.959854:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839466.959867:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6e400/0x4b63896d63640cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640ca7 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839466.959883:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6e400/0x4b63896d63640cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640ca7 expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839466.959891:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6e400/0x4b63896d63640cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640ca7 expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839466.959898:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e400, rc 0) 00000100:00100000:3.0:1788839466.959925:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+7:14353:x1875733747163520:12345-0@lo:101:mount.lustre.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839466.959930:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839466.959999:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839466.960009:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c6800/0x4b63896d63640ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640cae expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.960024:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c6800/0x4b63896d63640ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640cae expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839466.960034:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788839466.960038:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6800/0x4b63896d63640ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640cae expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.960043:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c6800/0x4b63896d63640ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640cae expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839466.960068:0:14353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788839466.960072:0:14353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788839466.960076:0:14353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91ea02e78800 10000000:01000000:0.0:1788839466.960079:0:14353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788839466.960081:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788839466.960083:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788839466.960095:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6a00/0x4b63896d63640cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.960101:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c6a00/0x4b63896d63640cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.960114:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c6a00/0x4b63896d63640cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839466.960125:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839466.960148:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839466.960162:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839466.960227:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163648 00000100:00100000:3.0:1788839466.960232:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163648 00000100:00100000:3.0:1788839466.960250:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839466.960256:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+7:14353:x1875733747163648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839466.960263:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839466.960271:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6f000/0x4b63896d63640cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640cb5 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839466.960284:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6f000/0x4b63896d63640cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640cb5 expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839466.960291:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6f000/0x4b63896d63640cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640cb5 expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839466.960308:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f000, rc 0) 00000100:00100000:3.0:1788839466.960334:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+8:14353:x1875733747163648:12345-0@lo:101:mount.lustre.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839466.960340:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839466.960409:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839466.960418:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c6a00/0x4b63896d63640cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640cbc expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839466.960425:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c6a00/0x4b63896d63640cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640cbc expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839466.960462:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839466.960485:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839466.960511:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839466.960791:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163776 00000100:00100000:2.0:1788839466.960796:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163776 00000100:00100000:2.0:1788839466.960827:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839466.960835:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+8:14353:x1875733747163776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839466.961229:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14353:x1875733747163776:12345-0@lo:501:mount.lustre.0 Request processed in 394us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839466.961237:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839466.961320:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839466.961351:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839466.961390:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839466.961421:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839466.961476:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747163904 00000100:00100000:2.0:1788839466.961480:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747163904 00000100:00100000:2.0:1788839466.961507:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839466.961514:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14353:x1875733747163904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839466.961782:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14353:x1875733747163904:12345-0@lo:503:mount.lustre.0 Request processed in 268us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839466.961795:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839466.961930:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747163904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839466.962452:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14389:1875733747164032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839466.962494:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839466.962559:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0615dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839466.962595:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747164032 00000100:00100000:0.0:1788839466.962600:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747164032 00000100:00100000:0.0:1788839466.962661:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839466.962669:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14389:x1875733747164032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839466.962916:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14389:x1875733747164032:12345-0@lo:502:llog_process_th.0 Request processed in 248us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839466.962924:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839466.962997:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14389:1875733747164032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839466.963029:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839466.963040:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839466.963042:0:14389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788839466.963076:0:14389:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788839466.963080:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839466.963096:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91eb336099b8) 00000020:00000080:2.0:1788839466.963116:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788839466.963122:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788839466.963186:0:14389:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788839466.963192:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d63640cca 00000020:00000080:2.0:1788839466.963422:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788839466.963428:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839466.963431:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839466.963433:0:14389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788839466.963436:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839466.963439:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839466.963441:0:14389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788839466.963444:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839466.963453:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff91eb3360cd28) 00000020:00000080:2.0:1788839466.963461:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788839466.963465:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788839466.963467:0:14389:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788839466.963470:0:14389:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788839466.963477:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788839466.963534:0:14389:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ea02e78800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788839466.963547:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff91eb33608000) 00000020:00000080:2.0:1788839466.963555:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788839466.963599:0:14389:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788839466.963605:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d63640cdf 00000020:00000080:2.0:1788839466.963695:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788839466.963702:0:14389:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788839466.963707:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b63896d63640ce6 00080000:01000000:2.0:1788839466.963712:0:14389:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788839466.963716:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d63640ced 00010000:00010000:2.0:1788839467.042983:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788839467.046459:0:14389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788839467.046791:0:14389:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788839467.047697:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91eb3360b370) 00000020:00000080:2.0:1788839467.047722:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788839467.047785:0:14389:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788839467.047792:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d63640cfb 00000020:00000080:2.0:1788839467.052568:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788839467.055316:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b63896d63640d02 00000020:00000080:3.0:1788839467.057527:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788839467.057541:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839467.057548:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.057551:0:14389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788839467.057554:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839467.057560:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.057562:0:14389:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788839467.057567:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788839467.057612:0:14389:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788839467.057628:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839467.057632:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.057633:0:14389:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788839467.057636:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788839467.057638:0:14389:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788839467.057639:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839467.057641:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839467.057643:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788839467.057645:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.057646:0:14389:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788839467.057649:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839467.057653:0:14389:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788839467.057656:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.057658:0:14389:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788839467.057661:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788839467.057666:0:14389:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:3.0:1788839467.057692:0:14389:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788839467.057701:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839467.057715:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91eb337719b8) 00000020:00000080:3.0:1788839467.057732:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788839467.057738:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788839467.057788:0:14389:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788839467.057794:0:14389:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788839467.057799:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d63640d10 00010000:00080000:3.0:1788839467.057830:0:14389:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb05afb800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:3.0:1788839467.058109:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788839467.058472:0:14389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788839467.058511:0:14389:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788839467.059476:0:14389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839467.059537:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788839467.059619:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788839467.062973:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788839467.062982:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788839467.073520:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788839467.073535:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788839467.073577:0:14389:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788839467.073599:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d63640d17 00000100:00080000:2.0:1788839467.073610:0:14389:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839467.073615:0:14389:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eb05afb800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1788839467.073658:0:14389:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb330f7b80 x1875733747164160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839467.073678:0:14389:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788839467.073781:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747164160:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788839467.073845:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875733747164160 offset 0 length 520: 4 00000020:01000000:2.0:1788839467.074336:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839467.074341:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839467.074355:0:14389:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788839467.074359:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788839467.074362:0:14389:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788839467.074364:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839467.074365:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839467.074367:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788839467.074370:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839467.074372:0:14389:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788839467.074374:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788839467.074379:0:14389:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788839467.074382:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839467.074384:0:14389:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788839467.074387:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788839467.074391:0:14389:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:2.0:1788839467.074414:0:14389:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788839467.074417:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839467.074431:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91eb09e099b8) 00000020:00000080:2.0:1788839467.074445:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788839467.074449:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788839467.074506:0:14389:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788839467.074512:0:14389:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788839467.074518:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b63896d63640d25 00010000:00080000:2.0:1788839467.074547:0:14389:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb3707f800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:2.0:1788839467.074770:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788839467.074965:0:14389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788839467.074989:0:14389:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788839467.075809:0:14389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839467.075879:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788839467.075963:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788839467.077724:0:14395:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788839467.077732:0:14395:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788839467.081434:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839467.081453:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788839467.081500:0:14389:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788839467.081524:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d63640d2c 00000100:00080000:3.0:1788839467.081536:0:14389:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839467.081542:0:14389:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eb3707f800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1788839467.081582:0:14389:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb37df0e00 x1875733747164288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839467.081648:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747164288:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788839467.081705:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875733747164288 offset 0 length 520: 4 00000100:00080000:3.0:1788839467.081767:0:14389:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788839467.081843:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839467.081848:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.081849:0:14389:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788839467.081852:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839467.081857:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.081858:0:14389:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839467.081861:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839467.081862:0:14389:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788839467.081875:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839467.081878:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.081879:0:14389:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788839467.081881:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839467.081884:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839467.081885:0:14389:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788839467.081889:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788839467.081918:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14389:1875733747164416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839467.081972:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839467.081989:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839467.082156:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747164416 00000100:00100000:0.0:1788839467.082166:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747164416 00000100:00100000:0.0:1788839467.082221:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839467.082231:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14389:x1875733747164416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839467.082513:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14389:x1875733747164416:12345-0@lo:502:llog_process_th.0 Request processed in 282us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839467.082522:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839467.082697:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14389:1875733747164416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839467.082738:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839467.082743:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839467.082745:0:14389:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839467.082750:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788839467.083452:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788839467.083475:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788839467.083501:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6a00/0x4b63896d63640cb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640cbc expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.083515:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c6a00/0x4b63896d63640cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640cbc expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839467.083524:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ea02e78800 from 1 10000000:01000000:0.0:1788839467.083528:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839467.083561:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.083569:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.083580:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839467.083611:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839467.083655:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839467.083692:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747164544 00000100:00100000:0.0:1788839467.083698:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747164544 00000100:00100000:0.0:1788839467.083731:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839467.083740:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+9:14353:x1875733747164544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839467.083751:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839467.083766:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640d33 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.083788:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640d33 expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.083799:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d33 expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.083809:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c7000, rc 0) 00000100:00100000:0.0:1788839467.083839:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+10:14353:x1875733747164544:12345-0@lo:101:mount.lustre.0 Request processed in 100us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839467.083845:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839467.083886:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839467.083901:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839467.083920:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.083928:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839467.084979:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164672:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788839467.085106:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839467.085144:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747164672 00000100:00100000:0.0:1788839467.085149:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747164672 00000100:00100000:0.0:1788839467.085184:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839467.085192:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+10:14353:x1875733747164672:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788839467.085536:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788839467.085543:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788839467.087623:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+10:14353:x1875733747164672:12345-0@lo:256:mount.lustre.0 Request processed in 2422us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839467.087639:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839467.087715:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839467.087742:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164672:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788839467.088796:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839467.088869:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.088883:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839467.088893:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ea02e78800 from 1 10000000:01000000:0.0:1788839467.088896:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839467.088937:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.088945:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839467.088969:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839467.088991:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839467.089151:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839467.089231:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e6de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839467.089514:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747164800 00000100:00100000:3.0:1788839467.089523:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747164800 00000100:00100000:3.0:1788839467.089607:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839467.089619:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+10:14353:x1875733747164800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839467.089631:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839467.089646:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640d41 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.089670:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640d41 expref: 11 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.089681:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d41 expref: 11 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.089689:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f400, rc 0) 00000100:00100000:3.0:1788839467.089736:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14353:x1875733747164800:12345-0@lo:101:mount.lustre.0 Request processed in 120us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839467.089743:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839467.089817:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839467.089832:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.089841:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839467.089912:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839467.089942:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839467.090526:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4074cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839467.090600:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747164928 00000100:00100000:0.0:1788839467.090605:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747164928 00000100:00100000:0.0:1788839467.090630:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839467.090637:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14353:x1875733747164928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839467.091188:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14353:x1875733747164928:12345-0@lo:501:mount.lustre.0 Request processed in 549us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839467.091205:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839467.091499:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747164928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839467.091550:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839467.091590:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839467.091621:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4074cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839467.091669:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165056 00000100:00100000:0.0:1788839467.091674:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165056 00000100:00100000:0.0:1788839467.091733:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788839467.091741:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14353:x1875733747165056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839467.091886:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14353:x1875733747165056:12345-0@lo:503:mount.lustre.0 Request processed in 145us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839467.091893:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839467.091960:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839467.092633:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14397:1875733747165184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839467.092676:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839467.092877:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4074c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839467.092936:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165184 00000100:00100000:2.0:1788839467.092944:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165184 00000100:00100000:2.0:1788839467.092976:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839467.092984:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14397:x1875733747165184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839467.093471:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14397:x1875733747165184:12345-0@lo:502:llog_process_th.0 Request processed in 486us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839467.093480:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839467.094866:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14397:1875733747165184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839467.094906:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839467.094917:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839467.094920:0:14397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839467.094928:0:14397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ea02e78800 00000020:00000080:1.0:1788839467.094931:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839467.094939:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839467.094942:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839467.094943:0:14397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788839467.094945:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839467.094947:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839467.094948:0:14397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788839467.094951:0:14397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ea02e78800 00000020:00000080:1.0:1788839467.094953:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839467.095395:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839467.095401:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839467.095402:0:14397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788839467.095405:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839467.095407:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839467.095409:0:14397:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839467.095412:0:14397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ea02e78800 00000020:00000080:1.0:1788839467.095414:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788839467.099571:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14397:1875733747165312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839467.099675:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839467.099739:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839467.099826:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165312 00000100:00100000:3.0:1788839467.099835:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165312 00000100:00100000:3.0:1788839467.099902:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839467.099913:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14397:x1875733747165312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839467.100223:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14397:x1875733747165312:12345-0@lo:502:llog_process_th.0 Request processed in 312us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839467.100231:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788839467.100465:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14397:1875733747165312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839467.100494:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839467.100501:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839467.100503:0:14397:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788839467.100510:0:14397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788839467.100682:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788839467.100703:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839467.100725:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.100735:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839467.100778:0:14353:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788839467.100781:0:14353:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ea02e78800 10000000:01000000:3.0:1788839467.100784:0:14353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ea02e78800 10000000:01000000:3.0:1788839467.100788:0:14353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839467.100794:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ea02e78800 from 1 10000000:01000000:3.0:1788839467.100797:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839467.100824:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e200/0x4b63896d63640d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.100833:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e200/0x4b63896d63640d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.100842:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e200/0x4b63896d63640d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839467.100857:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839467.100896:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839467.100923:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165440 00000100:00100000:3.0:1788839467.100927:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165440 00000100:00100000:3.0:1788839467.100954:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839467.100963:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14353:x1875733747165440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839467.100973:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839467.100986:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6ec00/0x4b63896d63640d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640d4f expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.101028:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6ec00/0x4b63896d63640d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640d4f expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.101039:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6ec00/0x4b63896d63640d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d4f expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.101070:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ec00, rc 0) 00000100:00100000:3.0:1788839467.101101:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14353:x1875733747165440:12345-0@lo:101:mount.lustre.0 Request processed in 139us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839467.101107:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839467.101147:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839467.101160:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839467.101173:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e200/0x4b63896d63640d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d56 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.101183:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e200/0x4b63896d63640d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640d56 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839467.101334:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839467.101374:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839467.101396:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165568 00000100:00100000:3.0:1788839467.101401:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165568 00000100:00100000:3.0:1788839467.101427:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839467.101434:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14353:x1875733747165568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839467.101659:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14353:x1875733747165568:12345-0@lo:501:mount.lustre.0 Request processed in 224us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839467.101665:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839467.101689:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839467.101700:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839467.101726:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165696:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839467.101760:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839467.101782:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165696 00000100:00100000:3.0:1788839467.101786:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165696 00000100:00100000:3.0:1788839467.101808:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839467.101816:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14353:x1875733747165696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839467.101944:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14353:x1875733747165696:12345-0@lo:503:mount.lustre.0 Request processed in 128us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839467.101951:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839467.101981:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839467.103309:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747165696:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839467.104444:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14400:1875733747165824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839467.104520:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839467.104556:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165824 00000100:00100000:3.0:1788839467.104562:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165824 00000100:00100000:3.0:1788839467.104606:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839467.104616:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14400:x1875733747165824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839467.104839:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14400:x1875733747165824:12345-0@lo:502:llog_process_th.0 Request processed in 225us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839467.104847:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839467.104899:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0615d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839467.104920:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14400:1875733747165824:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788839467.104979:0:14400:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788839467.106610:0:14400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91eb33770000) 00000020:00000080:3.0:1788839467.106639:0:14400:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788839467.106730:0:14400:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ea02e78800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788839467.106735:0:14400:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ea02e78800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788839467.106737:0:14400:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ea02e78800 4 00010000:00080000:3.0:1788839467.106787:0:14400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb3713a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:3.0:1788839467.115233:0:14400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788839467.115443:0:14400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788839467.115479:0:14400:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839467.115491:0:14400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b63896d63640d64 00000100:00080000:3.0:1788839467.115502:0:14400:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839467.115508:0:14400:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91eb3713a000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1788839467.115547:0:14400:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb37df2a00 x1875733747165952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839467.115588:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747165952:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839467.115673:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839467.115727:0:14400:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788839467.117730:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747165952 00000100:00100000:1.0:1788839467.117744:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747165952 00000100:00100000:1.0:1788839467.117791:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839467.117800:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875733747165952:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788839467.117883:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875733747165952:12345-0@lo:38:llog_process_th.0 Request processed in 83us (2209us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788839467.117890:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839467.118921:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839467.118931:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3713a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839467.118947:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788839467.118952:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747165952:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839467.119186:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14400:1875733747166080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839467.119317:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839467.119349:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166080 00000100:00100000:3.0:1788839467.119355:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166080 00000100:00100000:3.0:1788839467.119396:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839467.119405:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14400:x1875733747166080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839467.119676:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14400:x1875733747166080:12345-0@lo:502:llog_process_th.0 Request processed in 271us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839467.119684:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839467.119737:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839467.119751:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14400:1875733747166080:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788839467.119772:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788839467.119887:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788839467.119905:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788839467.119922:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e200/0x4b63896d63640d4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d56 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839467.119934:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6e200/0x4b63896d63640d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d56 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788839467.119988:0:14353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788839467.119991:0:14353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839467.119993:0:14353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839467.119994:0:14353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839467.119995:0:14353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839467.119997:0:14353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839467.120002:0:14353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839467.120004:0:14353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839467.120005:0:14353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839467.120006:0:14353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788839467.120010:0:14353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788839467.120022:0:14353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839467.120023:0:14353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839467.120024:0:14353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839467.120025:0:14353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839467.120026:0:14353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839467.120027:0:14353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839467.120028:0:14353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839467.120029:0:14353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839467.120030:0:14353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839467.120031:0:14353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788839467.120044:0:14353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788839467.120083:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747166208:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788839467.120116:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839467.120137:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166208 00000100:00100000:3.0:1788839467.120142:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166208 00000100:00100000:3.0:1788839467.120163:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839467.120169:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14353:x1875733747166208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788839467.120189:0:14364:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788839467.122655:0:14364:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788839467.131405:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb101c83c0 going to sleep for 11 seconds 20000000:01000000:3.0:1788839467.236129:0:14364:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788839467.236178:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788839467.236412:0:14387:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839467.236418:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839467.236440:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839467.236459:0:14387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d33 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839467.236486:0:14387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839467.236526:0:14387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d63640d33 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839467.236541:0:14387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d63640d33 expref: 12 pid: 14366 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839467.236557:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14387:1875733747166336:0@lo:104: 00000100:00100000:2.0:1788839467.238537:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839467.238619:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb4074c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839467.238717:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166336 00000100:00100000:1.0:1788839467.238726:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166336 00000100:00100000:1.0:1788839467.238782:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839467.238793:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14387:x1875733747166336:12345-0@lo:104: 00010000:00010000:1.0:1788839467.238810:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.238873:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839467.238879:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14387:x1875733747166336:12345-0@lo:104: Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839467.238887:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839467.238935:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14387:1875733747166336:0@lo:104: 00010000:00010000:1.0:1788839467.238956:0:14387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.238991:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839467.239018:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239025:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7400 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:1.0:1788839467.239029:0:14360:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239037:0:14360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839467.239044:0:14360:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839467.239066:0:14360:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839467.239101:0:14360:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239107:0:14360:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839467.239127:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239134:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb102c7400/0x4b63896d63640d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d3a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239153:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839467.239155:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839467.239157:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839467.239186:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3311:1875733747166464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839467.239241:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839467.239299:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166464 00000100:00100000:1.0:1788839467.239304:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166464 00010000:00010000:1.0:1788839467.239322:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d33 expref: 13 pid: 14366 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839467.239344:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839467.239350:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+13:3311:x1875733747166464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839467.239362:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839467.239367:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d33 expref: 13 pid: 14366 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239378:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d63640d33 expref: 13 pid: 14366 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239392:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c7000/0x4b63896d63640d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d63640d33 expref: 13 pid: 14366 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239407:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239416:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839467.239429:0:14356:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003011961s 00010000:00010000:1.0:1788839467.239433:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239440:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239456:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239462:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239466:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebba00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839467.239470:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239477:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239489:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239499:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839467.239526:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:3311:x1875733747166464:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839467.239533:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788839467.239558:0:14387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239565:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839467.239570:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09ebba00/0x4b63896d63640d6b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839467.239594:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3311:1875733747166464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839467.255080:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14353:x1875733747166208:12345-0@lo:253:mount.lustre.0 Request processed in 134881us (134934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839467.255101:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839467.255241:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14353:1875733747166208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788839467.255260:0:14353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788839467.255264:0:14353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839467.255266:0:14353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839467.255268:0:14353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839467.255269:0:14353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839467.255270:0:14353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839467.255272:0:14353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839467.255273:0:14353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839467.255274:0:14353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839467.255276:0:14353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839467.255278:0:14353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788839467.255302:0:14353:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788839467.269745:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839467.269906:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788839467.270753:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839467.270929:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788839467.271391:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839467.271543:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788839467.272528:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839467.272768:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788839467.273264:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839467.273478:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788839467.273764:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788839467.273904:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788839467.314913:0:14353:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788839467.315606:0:14353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788839467.315869:0:14411:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788839467.315946:0:14411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839467.317983:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788839467.318099:0:14411:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788839467.318104:0:14411:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788839467.321864:0:14353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788839467.321992:0:14353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788839467.322178:0:14410:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788839467.322182:0:14410:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1788839467.322787:0:14353:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788839467.322796:0:14353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788839467.322953:0:14353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839467.326181:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788839467.327409:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788839467.327467:0:14353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788839467.334790:0:14353:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788839467.357033:0:14353:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788839467.432851:0:14353:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788839467.432892:0:14353:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb24416d3988 00100000:10000000:0.0:1788839467.432902:0:14353:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788839467.434094:0:14353:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788839467.434110:0:14353:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788839467.434123:0:14353:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788839467.434140:0:14353:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788839467.779908:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839468.223380:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788839468.797498:0:14369:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788839468.797507:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ea02e78800 from 6 10000000:01000000:1.0:1788839468.797512:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788839468.797584:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839468.797596:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839468.797608:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839468.797635:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747166592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839468.797701:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839468.797753:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33079840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839468.798085:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166592 00000100:00100000:3.0:1788839468.798093:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166592 00000100:00100000:3.0:1788839468.798152:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839468.798161:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14369:x1875733747166592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839468.798174:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839468.798189:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640d72 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839468.798232:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640d72 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839468.798242:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d72 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839468.798250:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f800, rc 0) 00000100:00100000:3.0:1788839468.798294:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747166592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839468.798301:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788839468.798368:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839468.798755:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747166592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839468.798780:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839468.798790:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839468.798842:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747166720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788839468.798877:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839468.799098:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166720 00000100:00100000:2.0:1788839468.799104:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166720 00000100:00100000:2.0:1788839468.799153:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839468.799161:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747166720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788839468.799186:0:14364:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788839468.799203:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788839468.799206:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788839468.803833:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747166720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 4663us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839468.803849:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839468.804819:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33079840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839468.804856:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747166720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788839468.805243:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839468.805255:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839468.805266:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839469.246726:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788839469.830534:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839470.855214:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839471.869434:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788839472.305777:0:14653:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788839472.449625:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839472.449633:0:12628:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839472.449636:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788839472.449648:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747166848:0@lo:400:kworker.0 00000100:00080000:3.0:1788839472.449659:0:12628:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839472.449662:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788839472.449665:0:12628:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788839472.449669:0:12628:0:(import.c:65:import_set_state_nolock()) ffff91eb3713a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839472.449679:0:12628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91eb3713a000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1788839472.449706:0:12628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb37df1880 x1875733747166976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839472.449723:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839472.449814:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747166976:0@lo:38:kworker.0 00000100:00100000:0.0:1788839472.449844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839472.449909:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166976 00000100:00100000:3.0:1788839472.449928:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166976 00000100:00100000:3.0:1788839472.449964:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839472.449972:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875733747166976:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788839472.449973:0:14371:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788839472.449982:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1788839472.450118:0:14373:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:3.0:1788839472.450160:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b63896d63640d80 00000004:00100000:3.0:1788839472.450176:0:14373:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788839472.450573:0:14373:0:(import.c:65:import_set_state_nolock()) ffff91eb37139000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839472.450631:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875733747166976:12345-0@lo:38:kworker.0 Request processed in 657us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839472.450639:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788839472.450678:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eb37df1880 x1875733747166976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788839472.450694:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788839472.450703:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788839472.450708:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788839472.450710:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3713a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788839472.450717:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875733747166976:0@lo:38:kworker.0 00000100:00100000:2.0:1788839472.454496:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747166848 00000100:00100000:2.0:1788839472.454515:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747166848 00000100:00100000:2.0:1788839472.454669:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839472.454680:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:3312:x1875733747166848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839472.455423:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:3312:x1875733747166848:12345-0@lo:400:kworker.0 Request processed in 744us (5698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839472.455432:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839472.455558:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747166848:0@lo:400:kworker.0 00010000:00010000:3.0:1788839472.895442:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839473.918342:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839474.943003:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788839475.770729:0:14805:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa2a15020 20000000:00000080:3.0:1788839475.770746:0:14805:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eb401f1000 uarg=0000000000000000 20000000:01000000:3.0:1788839475.770848:0:14805:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788839475.770866:0:14805:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788839475.770871:0:14805:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788839475.771696:0:14806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788839475.771919:0:14805:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788839475.781560:0:14805:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788839475.781611:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839475.781634:0:14805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d41 expref: 11 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839475.781644:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839475.781690:0:14805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d63640d41 expref: 11 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839475.781708:0:14805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d63640d41 expref: 11 pid: 14365 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839475.781724:0:14805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14805:1875733747167104:0@lo:104: 00000100:00100000:3.0:1788839475.781924:0:14805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839475.782026:0:14805:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839475.782745:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747167104 00000100:00100000:3.0:1788839475.782754:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747167104 00000100:00100000:3.0:1788839475.782908:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839475.782919:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14805:x1875733747167104:12345-0@lo:104: 00010000:00010000:3.0:1788839475.782945:0:14355:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839475.783018:0:14355:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839475.783024:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14805:x1875733747167104:12345-0@lo:104: Request processed in 108us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839475.783031:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839475.783130:0:14805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14805:1875733747167104:0@lo:104: 00010000:00010000:0.0:1788839475.783150:0:14805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783253:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839475.783261:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783270:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6600 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:1.0:1788839475.783274:0:14359:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783282:0:14359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839475.783288:0:14359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839475.783294:0:14359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839475.783334:0:14359:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783341:0:14359:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839475.783364:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783383:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d48 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783397:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839475.783399:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839475.783401:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839475.783424:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747167232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839475.783472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839475.783526:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747167232 00000100:00100000:1.0:1788839475.783530:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747167232 00010000:00010000:1.0:1788839475.783547:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d41 expref: 12 pid: 14365 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839475.783568:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839475.783575:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:3313:x1875733747167232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839475.783585:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839475.783590:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d41 expref: 12 pid: 14365 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783601:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d63640d41 expref: 12 pid: 14365 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783614:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6f400/0x4b63896d63640d48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d63640d41 expref: 12 pid: 14365 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783626:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783642:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783654:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783660:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783666:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783672:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783677:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6fa00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839475.783681:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783688:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783699:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839475.783708:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839475.783735:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:3313:x1875733747167232:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839475.783742:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788839475.783920:0:14805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839475.783928:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839475.783934:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6fa00/0x4b63896d63640d87 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839475.784976:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747167232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839475.969915:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839476.990111:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839477.565488:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839467/real 1788839467] req@ffff91eb37df0e00 x1875733747164288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839477 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839477.565521:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91eb37df0e00 x1875733747164288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839477 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839477.565531:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839467/real 1788839467] req@ffff91eb330f7b80 x1875733747164160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839477 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839477.565542:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91eb330f7b80 x1875733747164160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839477 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788839477.565559:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839477.565573:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788839477.565577:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747164288:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788839477.565579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788839477.565628:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747167360:0@lo:400:kworker.0 00000100:00100000:1.0:1788839477.565691:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839477.565792:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839477.565794:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839477.565797:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788839477.565800:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839477.565804:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:0.0:1788839477.565809:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839477.565815:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eb3707f800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839477.565851:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb0f8f9c00 x1875733747167488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839477.565925:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747167616:0@lo:400:kworker.0 00000100:00100000:1.0:1788839477.565960:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839477.566290:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747167360 00000100:00100000:2.0:1788839477.566300:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747167360 00000100:00100000:2.0:1788839477.566349:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839477.566360:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:3314:x1875733747167360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839477.566417:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:3314:x1875733747167360:12345-0@lo:400:kworker.0 Request processed in 60us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.566425:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839477.566474:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747167616 00000100:00100000:2.0:1788839477.566479:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747167616 00000100:00100000:2.0:1788839477.566506:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839477.566514:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747167616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839477.566576:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747167616:12345-0@lo:400:kworker.0 Request processed in 52us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.566583:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788839477.566621:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eb0f8f8e00 x1875733747167616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839477.566634:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747167616:0@lo:400:kworker.0 00000100:00100000:2.0:1788839477.566670:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747167360:0@lo:400:kworker.0 00000100:00080000:3.0:1788839477.569164:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb05afb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839477.569338:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788839477.569346:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747164160:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788839477.569548:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747167488:0@lo:8:kworker.0 00000400:00000100:3.0:1788839477.569603:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875733747167488 offset 0 length 520: 4 00000100:00080000:0.0:1788839477.581638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839477.581649:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788839477.581654:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eb05afb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839477.581662:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:0.0:1788839477.581667:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839477.581674:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eb05afb800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839477.581716:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb0f8fb480 x1875733747167744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839477.581907:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747167744:0@lo:8:kworker.0 00000400:00000100:3.0:1788839477.581970:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875733747167744 offset 0 length 520: 4 10000000:01000000:0.0:1788839477.758380:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839477.758389:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ea02e78800 from 10 10000000:01000000:0.0:1788839477.758395:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839477.758444:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.758453:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.758477:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839477.758506:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747167872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839477.758577:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839477.758642:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e4f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.758886:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747167872 00000100:00100000:2.0:1788839477.758897:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747167872 00000100:00100000:2.0:1788839477.758962:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839477.758973:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+11:14369:x1875733747167872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839477.758988:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839477.759019:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640d8e expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.759084:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640d8e expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.759097:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d8e expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.759106:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09ebb000, rc 0) 00000100:00100000:2.0:1788839477.759164:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747167872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.759172:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839477.759382:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747167872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839477.759397:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.759418:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839477.759485:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747168000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839477.759513:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.759543:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788839477.759894:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168000 00000100:00100000:0.0:1788839477.759899:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168000 00000100:00100000:0.0:1788839477.759944:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839477.759950:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747168000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839477.760249:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747168000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839477.760256:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839477.760457:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747168000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839477.760492:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747168128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839477.760532:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839477.760564:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33079240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.760600:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168128 00000100:00100000:2.0:1788839477.760605:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168128 00000100:00100000:2.0:1788839477.760682:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839477.760691:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747168128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839477.760858:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:14369:x1875733747168128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.760865:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839477.760940:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747168128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788839477.761612:0:14866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788839477.761661:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788839477.761675:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839477.761683:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.761691:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839478.013184:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839479.037265:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839479.487560:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839480.061473:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839481.088070:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788839482.067504:0:15054:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788839482.067508:0:15054:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788839482.067649:0:15054:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eb106cd000 00000020:01000004:3.0:1788839482.067664:0:15054:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788839482.067677:0:15054:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788839482.067700:0:15054:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91eb40033370) 00000020:00000080:3.0:1788839482.067716:0:15054:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1788839482.112232:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788839482.122639:0:15054:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788839482.122920:0:15054:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788839482.131841:0:15054:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788839482.132099:0:15054:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788839482.132294:0:15054:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788839482.132611:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788839482.132701:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788839482.132812:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788839482.133209:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1788839482.133430:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1788839482.135904:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:2.0:1788839482.137519:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 775: rc = 0 00100000:10000000:2.0:1788839482.137802:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 775: rc = 0 00100000:10000000:3.0:1788839482.139486:0:15054:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 775: rc = 0 00000020:00000080:3.0:1788839482.140840:0:15054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788839482.140853:0:15054:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839482.140863:0:15054:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b63896d63640da3 00000020:01000004:3.0:1788839482.140871:0:15054:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788839482.140892:0:15054:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788839482.140895:0:15054:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788839482.140908:0:15054:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788839482.140913:0:15054:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788839482.140925:0:15054:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91eb400319b8) 00000020:00000080:3.0:1788839482.140935:0:15054:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788839482.142453:0:15054:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839482.142635:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788839482.142642:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788839482.148700:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788839482.148712:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788839482.150390:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788839482.150401:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788839482.151800:0:15054:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839482.152002:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788839482.152008:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788839482.157773:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788839482.157788:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788839482.202392:0:15054:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839482.202657:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788839482.202665:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788839482.209483:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788839482.209520:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788839482.213920:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788839482.213970:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788839482.228019:0:15054:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839482.235301:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788839482.235314:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788839482.240954:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788839482.240969:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788839482.313872:0:15054:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839482.315473:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788839482.315481:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788839482.335950:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788839482.335971:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788839482.337757:0:15054:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788839482.337781:0:15054:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788839482.337788:0:15054:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788839482.386138:0:15054:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839482.387505:0:15054:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788839482.387512:0:15054:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839482.387515:0:15054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839482.387516:0:15054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839482.387518:0:15054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839482.387519:0:15054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839482.387521:0:15054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839482.387522:0:15054:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839482.387524:0:15054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839482.387525:0:15054:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839482.387529:0:15054:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788839482.387531:0:15054:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839482.387532:0:15054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839482.387533:0:15054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839482.387535:0:15054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839482.387536:0:15054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839482.387537:0:15054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839482.387546:0:15054:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839482.387547:0:15054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839482.387548:0:15054:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839482.391384:0:15054:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788839482.391482:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788839482.391563:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839482.391666:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb062513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839482.394985:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168256 00000100:00100000:0.0:1788839482.394999:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168256 00000100:00100000:0.0:1788839482.395358:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839482.395369:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:15054:x1875733747168256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788839482.395406:0:14364:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788839482.395410:0:14364:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788839482.395423:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788839482.461913:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:15054:x1875733747168256:12345-0@lo:253:mount.lustre.0 Request processed in 66537us (70342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839482.461927:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839482.462102:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168256:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788839482.462119:0:15054:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788839482.462122:0:15054:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839482.462124:0:15054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839482.462125:0:15054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839482.462127:0:15054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839482.462128:0:15054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839482.462129:0:15054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839482.462130:0:15054:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839482.462132:0:15054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839482.462133:0:15054:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839482.462154:0:15054:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eb106cd000 from lustre-OST0000 10000000:01000000:3.0:1788839482.462189:0:15054:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788839482.462192:0:15054:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788839482.462199:0:15054:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eb3772cd28 local copy 00010000:00010000:3.0:1788839482.462210:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839482.462471:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839482.462507:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839482.462538:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1e5ca840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839482.462986:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168384 00000100:00100000:0.0:1788839482.462992:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168384 00000100:00100000:0.0:1788839482.463034:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839482.463044:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:15054:x1875733747168384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839482.463242:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:15054:x1875733747168384:12345-0@lo:501:mount.lustre.0 Request processed in 199us (734us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839482.463250:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839482.463514:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168384:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788839482.463529:0:15054:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788839482.463681:0:15054:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788839482.463689:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.463698:0:15054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839482.463791:0:15054:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eb106cd000 10000000:01000000:1.0:1788839482.463798:0:15054:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788839482.463804:0:15054:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91eb3772cd28 10000000:01000000:1.0:1788839482.463806:0:15054:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788839482.463810:0:15054:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91eb3772cd28 from 1 10000000:01000000:1.0:1788839482.463814:0:15054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788839482.463840:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9de00/0x4b63896d63640db1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.463849:0:15054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09c9de00/0x4b63896d63640db1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.463858:0:15054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09c9de00/0x4b63896d63640db1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839482.463871:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839482.463901:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.463935:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e4f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839482.465303:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168512 00000100:00100000:0.0:1788839482.465314:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168512 00000100:00100000:0.0:1788839482.465376:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839482.465385:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+12:15054:x1875733747168512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839482.465398:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839482.465414:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6000/0x4b63896d63640db8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640db1 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.465438:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6000/0x4b63896d63640db8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640db1 expref: 13 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.465449:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6000/0x4b63896d63640db8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640db1 expref: 13 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.465458:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6000, rc 0) 00000100:00100000:0.0:1788839482.465521:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+13:15054:x1875733747168512:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839482.465529:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839482.467560:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839482.467602:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09c9de00/0x4b63896d63640db1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640db8 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.467616:0:15054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9de00/0x4b63896d63640db1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640db8 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839482.467639:0:15054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788839482.467657:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9de00/0x4b63896d63640db1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640db8 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.467665:0:15054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09c9de00/0x4b63896d63640db1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640db8 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839482.467673:0:15054:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788839482.467678:0:15054:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839482.467684:0:15054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788839482.467687:0:15054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788839482.467713:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9c600/0x4b63896d63640dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.467720:0:15054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09c9c600/0x4b63896d63640dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.467767:0:15054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09c9c600/0x4b63896d63640dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839482.467785:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839482.467833:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.467874:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e4f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839482.468009:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168640 00000100:00100000:3.0:1788839482.468016:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168640 00000100:00100000:3.0:1788839482.468098:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839482.468108:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+13:15054:x1875733747168640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839482.468119:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839482.468133:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20a6e800/0x4b63896d63640dc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640dbf expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839482.468151:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6e800/0x4b63896d63640dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640dbf expref: 14 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839482.468177:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20a6e800/0x4b63896d63640dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640dbf expref: 14 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839482.468185:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e800, rc 0) 00000100:00100000:3.0:1788839482.468218:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747168640:12345-0@lo:101:mount.lustre.0 Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839482.468224:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839482.469838:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839482.469857:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09c9c600/0x4b63896d63640dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640dc6 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.469868:0:15054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9c600/0x4b63896d63640dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640dc6 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839482.470673:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788839482.472616:0:15054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839482.472890:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788839482.472933:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788839482.472964:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788839482.473010:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788839482.473045:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788839482.473117:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788839482.473179:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788839482.473186:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788839482.473268:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839482.473332:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.473384:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e4fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839482.473731:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168768 00000100:00100000:3.0:1788839482.473748:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168768 00000100:00100000:3.0:1788839482.473802:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839482.473812:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747168768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839482.474177:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747168768:12345-0@lo:501:mount.lustre.0 Request processed in 354us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839482.474185:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788839482.474597:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839482.474633:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839482.474676:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.474706:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e4fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839482.474810:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747168896 00000100:00100000:2.0:1788839482.474816:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747168896 00000100:00100000:2.0:1788839482.474848:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839482.474855:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747168896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839482.478929:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747168896:12345-0@lo:503:mount.lustre.0 Request processed in 4064us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839482.478944:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788839482.485883:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747168896:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839482.486859:0:15054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839482.486932:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839482.487011:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.487147:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e4fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839482.492558:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169024 00000100:00100000:3.0:1788839482.492574:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169024 00000100:00100000:3.0:1788839482.492674:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788839482.492685:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747169024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839482.493041:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747169024:12345-0@lo:502:mount.lustre.0 Request processed in 357us (6029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839482.493078:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839482.495119:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839482.498475:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788839482.498568:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788839482.498602:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788839482.498648:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788839482.498686:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788839482.498756:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788839482.498807:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788839482.498842:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788839482.498875:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788839482.498924:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788839482.498958:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788839482.499013:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788839482.499087:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839482.499184:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.500984:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb09e4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839482.507250:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169152 00000100:00100000:0.0:1788839482.507265:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169152 00000100:00100000:1.0:1788839482.507451:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839482.507461:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747169152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839482.507758:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747169152:12345-0@lo:502:mount.lustre.0 Request processed in 297us (8574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839482.507767:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839482.508218:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839482.508440:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788839482.508455:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788839482.510446:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839482.510456:0:15068:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788839482.510463:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.510465:0:15068:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788839482.510470:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839482.510492:0:15068:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91eb37728000) 00000020:00000080:1.0:1788839482.510521:0:15068:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788839482.510527:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788839482.510588:0:15068:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eb106cd000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788839482.510597:0:15068:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788839482.510608:0:15068:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b63896d63640dd4 00010000:00010000:1.0:1788839482.519751:0:15068:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788839482.520986:0:15068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788839482.524534:0:15068:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788839482.526494:0:15068:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788839482.526507:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839482.526514:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.526516:0:15068:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788839482.526520:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788839482.526523:0:15068:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788839482.526524:0:15068:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839482.526526:0:15068:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839482.526528:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788839482.526530:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.526531:0:15068:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839482.526534:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839482.526537:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.526539:0:15068:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788839482.526542:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788839482.526544:0:15068:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788839482.526546:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839482.526550:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.526551:0:15068:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788839482.526553:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839482.526555:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.526556:0:15068:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788839482.526559:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788839482.526615:0:15068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839482.526619:0:15068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.526627:0:15068:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788839482.526631:0:15068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788839482.526829:0:15054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788839482.526856:0:15054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788839482.526884:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9c600/0x4b63896d63640dbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640dc6 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.526897:0:15054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09c9c600/0x4b63896d63640dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640dc6 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839482.526905:0:15054:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb106cd000 from 1 10000000:01000000:0.0:1788839482.526909:0:15054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839482.526948:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.526956:0:15054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.526968:0:15054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839482.526992:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839482.527100:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839482.527144:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1e721900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839482.527478:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169280 00000100:00100000:1.0:1788839482.527487:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169280 00000100:00100000:1.0:1788839482.527529:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788839482.527539:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+14:15054:x1875733747169280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839482.527552:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839482.527565:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640ddb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.527590:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640ddb expref: 15 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.527601:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640ddb expref: 15 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.527609:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c800, rc 0) 00000100:00100000:1.0:1788839482.527651:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169280:12345-0@lo:101:mount.lustre.0 Request processed in 114us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839482.527658:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788839482.529886:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839482.529910:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.529922:0:15054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839482.530665:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788839482.532473:0:15054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839482.533440:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788839482.533492:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788839482.533553:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788839482.533561:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788839482.533667:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839482.533770:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839482.538807:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1e721900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839482.541221:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169408 00000100:00100000:2.0:1788839482.541232:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169408 00000100:00100000:2.0:1788839482.541285:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839482.541295:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839482.541875:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169408:12345-0@lo:501:mount.lustre.0 Request processed in 580us (8104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839482.541883:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839482.542022:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839482.542104:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839482.542154:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.542186:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb071eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839482.542437:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169536 00000100:00100000:2.0:1788839482.542443:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169536 00000100:00100000:2.0:1788839482.542474:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788839482.542481:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839482.542619:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169536:12345-0@lo:503:mount.lustre.0 Request processed in 138us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839482.542627:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788839482.542696:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839482.543190:0:15054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839482.543257:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839482.543296:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.543331:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb071eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839482.543514:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169664 00000100:00100000:2.0:1788839482.543519:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169664 00000100:00100000:2.0:1788839482.543548:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788839482.543555:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839482.543685:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169664:12345-0@lo:502:mount.lustre.0 Request processed in 130us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839482.543693:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839482.543875:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839482.544211:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788839482.544259:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788839482.544305:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788839482.544406:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788839482.544437:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788839482.544477:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788839482.544510:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788839482.544541:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788839482.544566:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839482.544602:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.544628:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb071eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839482.544686:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169792 00000100:00100000:2.0:1788839482.544690:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169792 00000100:00100000:2.0:1788839482.544809:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788839482.544819:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839482.544951:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169792:12345-0@lo:502:mount.lustre.0 Request processed in 134us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839482.544997:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839482.545118:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788839482.545128:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788839482.546350:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839482.546360:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.546363:0:15072:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839482.546369:0:15072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb106cd000 00000020:00000080:1.0:1788839482.546371:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839482.546378:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839482.546380:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.546382:0:15072:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788839482.546384:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839482.546387:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.546388:0:15072:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788839482.546391:0:15072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eb106cd000 00000020:00000080:1.0:1788839482.546399:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839482.546457:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839482.546460:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.546462:0:15072:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788839482.546464:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839482.546467:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.546468:0:15072:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839482.546471:0:15072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eb106cd000 00000020:00000080:1.0:1788839482.546474:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839482.546507:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839482.546510:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839482.546512:0:15072:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788839482.546515:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788839482.546699:0:15054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788839482.546732:0:15054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839482.546762:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839482.546785:0:15054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839482.546824:0:15054:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788839482.546827:0:15054:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eb106cd000 10000000:01000000:3.0:1788839482.546830:0:15054:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eb106cd000 10000000:01000000:3.0:1788839482.546834:0:15054:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839482.546840:0:15054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eb106cd000 from 1 10000000:01000000:3.0:1788839482.546842:0:15054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839482.546876:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d63640de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839482.546883:0:15054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d63640de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839482.546894:0:15054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d63640de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839482.546916:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839482.546981:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839482.547020:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1e5ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839482.549863:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747169920 00000100:00100000:1.0:1788839482.549878:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747169920 00000100:00100000:2.0:1788839482.556968:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788839482.563482:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788839482.563504:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747169920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839482.563524:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839482.563543:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9d400/0x4b63896d63640df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640de9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.563575:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9d400/0x4b63896d63640df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640de9 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.563587:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9d400/0x4b63896d63640df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640de9 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.563596:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d400, rc 0) 00000100:00100000:1.0:1788839482.563686:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747169920:12345-0@lo:101:mount.lustre.0 Request processed in 190us (16703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839482.563694:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839482.563934:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747169920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839482.563953:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d63640de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640df0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839482.563962:0:15054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d63640de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640df0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839482.565649:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788839482.566156:0:15054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839482.566417:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788839482.566462:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788839482.566499:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788839482.566547:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788839482.566585:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788839482.566635:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788839482.566673:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788839482.566706:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788839482.571006:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788839482.571109:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788839482.571165:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788839482.571216:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788839482.571252:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788839482.571285:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788839482.577100:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788839482.577203:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788839482.577240:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788839482.577288:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788839482.577339:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788839482.577374:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788839482.577423:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788839482.577460:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788839482.577494:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788839482.577537:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788839482.577571:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788839482.577604:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788839482.577686:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788839482.577753:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788839482.577850:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788839482.577864:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788839482.577975:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839482.578047:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839482.578115:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839482.580129:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170048 00000100:00100000:3.0:1788839482.580142:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170048 00000100:00100000:3.0:1788839482.580192:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839482.580202:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839482.581360:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170048:12345-0@lo:501:mount.lustre.0 Request processed in 1156us (3309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839482.581370:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839482.581449:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839482.581501:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839482.581546:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839482.581578:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839482.584914:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170176 00000100:00100000:1.0:1788839482.584928:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170176 00000100:00100000:1.0:1788839482.584974:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839482.584984:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839482.585433:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170176:12345-0@lo:503:mount.lustre.0 Request processed in 450us (3886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839482.585442:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788839482.595456:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788839482.596700:0:15054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839482.598494:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839482.598574:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839482.598618:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839482.599424:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170304 00000100:00100000:1.0:1788839482.599431:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170304 00000100:00100000:1.0:1788839482.599477:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788839482.599498:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839482.599850:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170304:12345-0@lo:502:mount.lustre.0 Request processed in 353us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839482.599858:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788839482.600293:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839482.600583:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788839482.600636:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788839482.600668:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788839482.600711:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788839482.600873:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788839482.600921:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788839482.600955:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788839482.600987:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788839482.601032:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788839482.601099:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788839482.601131:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788839482.601175:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788839482.601207:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788839482.601238:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788839482.601284:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788839482.602494:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788839482.602556:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788839482.602610:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788839482.602646:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788839482.602689:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788839482.603009:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788839482.603143:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788839482.603185:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788839482.603233:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788839482.603266:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788839482.603298:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788839482.603449:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788839482.603486:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788839482.603520:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788839482.603572:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788839482.603608:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788839482.603638:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788839482.603670:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788839482.603716:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788839482.604412:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788839482.604481:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788839482.604533:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788839482.604570:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788839482.604622:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788839482.604659:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788839482.604710:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839482.604865:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839482.604913:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb1e721780 going to sleep for 11 seconds 00000100:00100000:1.0:1788839482.606966:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170432 00000100:00100000:1.0:1788839482.606976:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170432 00000100:00100000:1.0:1788839482.607035:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839482.607045:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170432:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839482.607350:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170432:12345-0@lo:502:mount.lustre.0 Request processed in 306us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839482.607358:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788839482.607592:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170432:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839482.607695:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788839482.607710:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788839482.612015:0:15077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788839482.612033:0:15077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91eb0f900000) 00000020:00000080:0.0:1788839482.612084:0:15077:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788839482.612154:0:15077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eb106cd000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788839482.612163:0:15077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eb106cd000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788839482.612166:0:15077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eb106cd000 3 00010000:00080000:0.0:1788839482.612198:0:15077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eb033c9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1788839482.614853:0:15077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788839482.620212:0:15077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788839482.620257:0:15077:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788839482.620271:0:15077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b63896d63640dfe 00000100:00080000:0.0:1788839482.620283:0:15077:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788839482.620290:0:15077:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91eb033c9000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839482.620423:0:15077:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb0f8f9180 x1875733747170560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839482.620447:0:15077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788839482.620602:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875733747170560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839482.620677:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839482.620847:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839482.620852:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839482.620868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839482.620871:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839482.620920:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839482.620930:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747170688:0@lo:400:kworker.0 00000100:00100000:2.0:1788839482.620958:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839482.621095:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170560 00000100:00100000:0.0:1788839482.621102:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170560 00000100:00100000:0.0:1788839482.621133:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170688 00000100:00100000:0.0:1788839482.621136:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170688 00000100:00100000:0.0:1788839482.621168:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839482.621177:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747170688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839482.621231:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747170688:12345-0@lo:400:kworker.0 Request processed in 54us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839482.621238:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839482.621252:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839482.621256:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875733747170560:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788839482.621275:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:0.0:1788839482.621490:0:14371:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b63896d63640e05 00000004:00100000:0.0:1788839482.621505:0:14371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788839482.621533:0:14371:0:(import.c:65:import_set_state_nolock()) ffff91eb033cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839482.621586:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875733747170560:12345-0@lo:38:llog_process_th.0 Request processed in 328us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839482.621593:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788839482.621629:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eb330f6300 x1875733747170688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839482.621644:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747170688:0@lo:400:kworker.0 00000040:00080000:0.0:1788839482.622632:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1788839482.622927:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eb0f8f9180 x1875733747170560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839482.622938:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839482.622955:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788839482.622962:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788839482.622967:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788839482.622970:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb033c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788839482.622976:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875733747170560:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788839482.628267:0:15054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788839482.628312:0:15054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839482.628342:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d63640de9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640df0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839482.628355:0:15054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6fc00/0x4b63896d63640de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640df0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839482.628441:0:15054:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788839482.628444:0:15054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788839482.628445:0:15054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839482.628446:0:15054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839482.628447:0:15054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839482.628448:0:15054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839482.628449:0:15054:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839482.628451:0:15054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839482.628452:0:15054:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839482.628456:0:15054:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788839482.628458:0:15054:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839482.628459:0:15054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788839482.628460:0:15054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839482.628461:0:15054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839482.628462:0:15054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839482.628463:0:15054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839482.628464:0:15054:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839482.628465:0:15054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839482.628466:0:15054:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839482.628492:0:15054:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788839482.628515:0:15054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170816:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788839482.628590:0:15054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839482.628640:0:15054:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839482.630364:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170816 00000100:00100000:2.0:1788839482.630377:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170816 00000100:00100000:2.0:1788839482.630436:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839482.630446:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15054:x1875733747170816:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788839482.630497:0:14365:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788839482.630510:0:14365:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788839482.682953:0:14365:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788839482.682972:0:14365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788839482.683564:0:14387:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788839482.683570:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788839482.683591:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.683609:0:14387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d72 expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.683634:0:14387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.683796:0:14387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d63640d72 expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839482.683812:0:14387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d63640d72 expref: 16 pid: 14365 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839482.683827:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14387:1875733747170944:0@lo:104: 00000100:00100000:1.0:1788839482.683894:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839482.683942:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb071ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839482.684036:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747170944 00000100:00100000:2.0:1788839482.684044:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747170944 00000100:00100000:2.0:1788839482.684118:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839482.684129:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14387:x1875733747170944:12345-0@lo:104: 00010000:00010000:2.0:1788839482.684141:0:14355:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839482.684194:0:14355:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839482.684201:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14387:x1875733747170944:12345-0@lo:104: Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839482.684208:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839482.684296:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14387:1875733747170944:0@lo:104: 00010000:00010000:3.0:1788839482.684316:0:14387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.684926:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839482.684935:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.684943:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d800 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:0.0:1788839482.684947:0:14359:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.684956:0:14359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839482.684963:0:14359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839482.684969:0:14359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839482.685007:0:14359:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685014:0:14359:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839482.685041:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685068:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d79 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685094:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839482.685096:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839482.685098:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839482.685110:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839482.685120:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747171072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839482.685157:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839482.685201:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171072 00000100:00100000:0.0:1788839482.685205:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171072 00010000:00010000:0.0:1788839482.685221:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d72 expref: 17 pid: 14365 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839482.685242:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839482.685249:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:3314:x1875733747171072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839482.685260:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839482.685265:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d72 expref: 17 pid: 14365 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685276:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d63640d72 expref: 17 pid: 14365 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685288:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6f800/0x4b63896d63640d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d63640d72 expref: 17 pid: 14365 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685299:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685308:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788839482.685337:0:14356:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003011961s 00010000:00010000:0.0:1788839482.685341:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685349:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685355:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685362:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685368:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839482.685372:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685380:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685395:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685403:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839482.685432:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3314:x1875733747171072:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839482.685439:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839482.685468:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747171072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839482.685483:0:14387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685496:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839482.685502:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640e0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839482.701923:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:15054:x1875733747170816:12345-0@lo:253:mount.lustre.0 Request processed in 71469us (73324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839482.701938:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788839482.705559:0:15054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15054:1875733747170816:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788839482.705581:0:15054:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788839482.705584:0:15054:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839482.705586:0:15054:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839482.705587:0:15054:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839482.705588:0:15054:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839482.705589:0:15054:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839482.705591:0:15054:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839482.705592:0:15054:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839482.705593:0:15054:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839482.705595:0:15054:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788839482.705609:0:15054:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788839482.709579:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788839482.709730:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788839482.710411:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788839482.710529:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788839482.710680:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788839482.711035:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788839482.714302:0:15054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788839482.777372:0:15054:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788839482.777394:0:15054:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788839482.777429:0:15054:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788839482.777479:0:15054:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788839482.777492:0:15054:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788839482.777521:0:15054:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788839483.135246:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788839484.157278:0:14369:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788839484.157286:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ea02e78800 from 7 10000000:01000000:1.0:1788839484.157297:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788839484.157342:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839484.157354:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839484.157366:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839484.157391:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747171200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839484.157459:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839484.157506:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb071eac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839484.157638:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171200 00000100:00100000:0.0:1788839484.157645:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171200 00000100:00100000:0.0:1788839484.157697:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788839484.157717:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+15:14369:x1875733747171200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839484.157730:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839484.157745:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640e13 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839484.157768:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640e13 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839484.157779:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640e13 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839484.157788:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb102c6e00, rc 0) 00000100:00100000:0.0:1788839484.157829:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:14369:x1875733747171200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839484.157837:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788839484.157879:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747171200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839484.157897:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839484.158207:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839484.158333:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747171328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788839484.158369:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839484.158401:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb3309cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839484.158493:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171328 00000100:00100000:0.0:1788839484.158498:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171328 00000100:00100000:0.0:1788839484.158529:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839484.158536:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:14369:x1875733747171328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788839484.158551:0:14365:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839484.158566:0:14365:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839484.158569:0:14365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788839484.158649:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:14369:x1875733747171328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839484.158655:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788839484.158750:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747171328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788839484.158811:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788839484.158818:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839484.158826:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839484.160490:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839485.182151:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839486.205245:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839487.237138:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839487.810501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839487.810530:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839487.810533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839487.810537:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788839487.810637:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747171456:0@lo:400:kworker.0 00000100:00100000:1.0:1788839487.810747:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839487.810829:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747171584:0@lo:400:kworker.0 00000100:00100000:1.0:1788839487.810860:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839487.810882:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839487.810889:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747171712:0@lo:400:kworker.0 00000100:00100000:1.0:1788839487.811436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839487.811483:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171456 00000100:00100000:1.0:1788839487.811491:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171456 00000100:00100000:1.0:1788839487.811539:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839487.811548:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3314:x1875733747171456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839487.811604:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3314:x1875733747171456:12345-0@lo:400:kworker.0 Request processed in 57us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839487.811632:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839487.811688:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171584 00000100:00100000:1.0:1788839487.811692:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171584 00000100:00100000:1.0:1788839487.811715:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171712 00000100:00100000:1.0:1788839487.811717:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171712 00000100:00100000:1.0:1788839487.811893:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839487.811901:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747171584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839487.812099:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747171584:12345-0@lo:400:kworker.0 Request processed in 199us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839487.812298:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839487.812316:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839487.812323:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747171712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839487.812355:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747171712:12345-0@lo:400:kworker.0 Request processed in 34us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839487.812362:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788839487.813557:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788839487.814497:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb37dcd500 x1875733747171712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839487.814518:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747171712:0@lo:400:kworker.0 00010000:00080000:1.0:1788839487.814534:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb37dcca80 x1875733747171584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839487.814542:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747171584:0@lo:400:kworker.0 00000100:00100000:1.0:1788839487.814583:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747171456:0@lo:400:kworker.0 00010000:00010000:1.0:1788839488.266109:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839489.277642:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839489.725916:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788839490.304963:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788839491.176839:0:15422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788839491.325517:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839492.359138:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839492.865805:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839477/real 1788839477] req@ffff91eb0f8fb480 x1875733747167744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839492.865836:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91eb0f8fb480 x1875733747167744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839492.865846:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839477/real 1788839477] req@ffff91eb0f8f9c00 x1875733747167488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839492.865858:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91eb0f8f9c00 x1875733747167488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788839492.865888:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb05afb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839492.865915:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788839492.865919:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747167744:0@lo:8:kworker.0 00000100:00080000:1.0:1788839492.865925:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839492.865931:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788839492.865933:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747167488:0@lo:8:kworker.0 00000100:00080000:3.0:1788839492.866606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839492.866611:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788839492.866614:0:37:0:(import.c:65:import_set_state_nolock()) ffff91eb05afb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839492.866619:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1788839492.866624:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788839492.866630:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eb05afb800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1788839492.866651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb37df3100 x1875733747171968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839492.866663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839492.866666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788839492.866667:0:37:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839492.866670:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1788839492.866672:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788839492.866675:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eb3707f800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1788839492.866685:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb37df2a00 x1875733747172096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839492.866828:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747171840:0@lo:400:kworker.0 00000100:00100000:1.0:1788839492.866895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839492.866957:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839492.866963:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747172224:0@lo:400:kworker.0 00000100:00100000:1.0:1788839492.866990:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839492.867021:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747172352:0@lo:400:kworker.0 00000100:00100000:1.0:1788839492.867043:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839492.867109:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172224 00000100:00100000:1.0:1788839492.867117:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172224 00000100:00100000:1.0:1788839492.867156:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172352 00000100:00100000:1.0:1788839492.867159:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172352 00000100:00100000:1.0:1788839492.867183:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839492.867192:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747172224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839492.867242:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747172224:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839492.867250:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839492.867268:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839492.867273:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747172352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839492.867318:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747172352:12345-0@lo:400:kworker.0 Request processed in 45us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839492.867325:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788839492.867363:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb37df3800 x1875733747172352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839492.867375:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747172352:0@lo:400:kworker.0 00000100:00100000:1.0:1788839492.867394:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747171968:0@lo:8:kworker.0 00000100:00100000:1.0:1788839492.867421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839492.867445:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747172096:0@lo:8:kworker.0 00000100:00100000:1.0:1788839492.867465:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788839492.867497:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb37df3b80 x1875733747172224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839492.867506:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747172224:0@lo:400:kworker.0 00000100:00100000:3.0:1788839492.867951:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171840 00000100:00100000:3.0:1788839492.867957:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171840 00000100:00100000:3.0:1788839492.867993:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788839492.868001:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3313:x1875733747171840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839492.868079:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3313:x1875733747171840:12345-0@lo:400:kworker.0 Request processed in 78us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839492.868086:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788839492.868121:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747171968 00000100:00100000:3.0:1788839492.868125:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747171968 00000100:00100000:3.0:1788839492.868139:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172096 00000100:00100000:3.0:1788839492.868141:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172096 00000100:00100000:3.0:1788839492.868150:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839492.868155:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875733747171968:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788839492.868178:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:3.0:1788839492.868205:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d63640e21 00002000:00100000:3.0:1788839492.868218:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91eb033ed800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788839492.868222:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788839492.868225:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788839492.868544:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788839492.868580:0:15055:0:(import.c:65:import_set_state_nolock()) ffff91eb033ec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839492.868620:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875733747171968:12345-0@lo:8:kworker.0 Request processed in 463us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839492.868627:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839492.868640:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839492.868644:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875733747172096:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788839492.868654:0:15055:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788839492.868677:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875733747172096:12345-0@lo:8:kworker.0 Request processed in 31us (1211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839492.868683:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788839492.871778:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839492.872328:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747171840:0@lo:400:kworker.0 00010000:00080000:1.0:1788839492.872379:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb37df3100 x1875733747171968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839492.872390:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839492.872398:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788839492.872407:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788839492.872412:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788839492.872416:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb05afb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788839492.872440:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788839492.872446:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747171968:0@lo:8:kworker.0 00000100:00080000:1.0:1788839492.872469:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839492.872473:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788839492.872476:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747172096:0@lo:8:kworker.0 00000004:00080000:1.0:1788839492.872498:0:14393:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788839492.872786:0:14393:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 475563735171ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788839492.881874:0:14394:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788839492.881909:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1875733747172608:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788839492.881985:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839492.882020:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10bb6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839492.882294:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839492.882309:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747172480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839492.882337:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839492.882375:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172608 00000100:00100000:2.0:1788839492.882411:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172608 00000100:00100000:2.0:1788839492.882467:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839492.882488:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14394:x1875733747172608:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788839492.890355:0:15055:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788839492.890366:0:15055:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788839492.890371:0:15055:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:0.0:1788839492.894995:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172480 00000100:00100000:0.0:1788839492.895012:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172480 00000100:00100000:0.0:1788839492.895090:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839492.895102:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747172480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839492.895141:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839492.895226:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747172480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (12887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839492.895244:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788839492.895309:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb330f6680 x1875733747172480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839492.895329:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747172480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788839492.926929:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788839492.928377:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839492.928388:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928416:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1788839492.928421:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839492.928427:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928445:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928456:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928464:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928483:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839492.928496:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839492.928502:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928509:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839492.928513:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928522:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.928547:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839492.937304:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.937316:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937332:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.937337:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.937344:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937359:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937369:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937376:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937396:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839492.937410:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788839492.937846:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.937853:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937866:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.937869:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.937874:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937883:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937891:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937897:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.937906:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788839492.944376:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.944390:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944409:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.944414:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.944420:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944437:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944461:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944468:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944479:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788839492.944906:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.944912:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944922:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.944925:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.944929:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944938:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944945:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944952:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.944971:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788839492.945379:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.945385:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.945393:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.945396:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.945400:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.945409:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.945417:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.945423:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.945432:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788839492.950721:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61bba87/0x4b63896d63640e28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.950961:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788839492.950968:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.950977:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839492.950982:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.950994:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951013:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951020:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640e36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951036:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788839492.951040:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951072:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839492.951076:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951083:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951093:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951101:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951112:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839492.951116:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951122:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839492.951125:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951132:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951141:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951153:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951165:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839492.951168:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951175:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839492.951178:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951187:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951196:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951202:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.951212:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839492.951213:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839492.951215:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839492.991318:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.991332:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.991350:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.991361:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.991368:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.991382:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.991392:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.991399:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.991418:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788839492.992073:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.992080:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992089:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.992092:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.992097:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992106:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992113:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992127:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992135:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788839492.992504:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839492.992510:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992518:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839492.992521:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839492.992525:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992533:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992540:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839492.992547:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995119:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839492.995132:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995151:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839492.995156:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995166:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995185:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995192:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995209:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839492.995214:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995220:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839492.995223:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995230:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995238:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995253:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839492.995265:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839492.995267:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839492.995269:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.002180:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.002194:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.002208:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839493.002213:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.002223:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.002246:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.002253:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640e2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.002273:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.002274:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.002276:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.002280:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.002282:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.011664:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.011684:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.011692:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.011714:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.011719:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.011728:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.011747:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.011755:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.011777:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.011779:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.011781:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.019725:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.019739:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019756:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.019760:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.019767:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019781:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019802:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019810:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019830:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.019846:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.019852:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019859:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.019863:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019872:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019887:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019894:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.019911:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.019919:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.019920:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.020785:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.020794:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.020803:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.020807:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.020812:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.020822:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.020831:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.020839:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.020862:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788839493.021303:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.021309:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.021318:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.021321:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.021325:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.021342:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.021350:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.021356:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.021370:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788839493.021381:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839493.021387:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.021394:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.021398:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022738:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022759:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022768:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022800:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.022805:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022812:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.022816:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022824:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022834:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022842:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.022854:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.022856:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.022858:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839493.022977:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788839493.023877:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788839493.028908:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.028920:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.028935:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.028946:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.028953:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.028966:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.028977:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.028986:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.029003:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.029015:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.029020:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.029028:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.029032:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.029040:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.030660:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.030691:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640e7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.030709:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.030712:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.030713:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.031308:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.031316:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.031327:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.031331:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.031336:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.031348:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.031372:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.031380:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.031396:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.031415:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.035087:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.035103:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.035108:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.035119:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.035142:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.035150:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005726a919/0x4b63896d63640e83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.035169:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.035171:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.035174:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.041432:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.041445:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.041462:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.041466:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.041472:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.041496:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.041506:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.041513:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.041531:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788839493.042346:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.042352:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042362:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.042366:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.042370:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042379:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042387:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042405:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042419:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788839493.042430:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839493.042435:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042443:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.042448:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042457:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042472:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042480:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef585c7a/0x4b63896d63640e8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042496:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.042500:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042518:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.042521:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042528:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042538:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042543:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b91d262c/0x4b63896d63640e91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.042566:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.042569:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.042570:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.042989:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.042995:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043003:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.043007:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.043012:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043021:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043037:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043044:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043078:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.043087:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.043092:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043099:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.043103:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043111:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043123:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043131:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029038543/0x4b63896d63640e98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.043143:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.043162:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.043164:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839493.043342:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.044433:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.044441:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.044453:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.044456:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.044462:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.044472:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.044481:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.044488:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.044502:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.044510:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.044515:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.044523:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.044526:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.044544:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.049867:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.049880:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e908a1/0x4b63896d63640e9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.049904:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.049907:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.049911:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.052302:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.052315:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.052334:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.052339:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.052346:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.052360:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.052371:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.052388:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.052653:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839493.052714:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839493.052723:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.052734:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839493.052740:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.052751:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.052770:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.052778:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b01614b/0x4b63896d63640ea6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.052799:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.052802:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.052804:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.054297:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.054308:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054320:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.054325:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.054330:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054341:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054350:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054358:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054375:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.054386:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.054392:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054470:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.054475:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054483:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054497:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054504:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba4fdee/0x4b63896d63640ead lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.054519:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.054521:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.054523:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.055029:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.055036:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055044:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.055047:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.055072:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055082:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055097:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055104:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055117:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.055125:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.055130:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055137:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.055141:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055149:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055160:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055169:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acefe900/0x4b63896d63640eb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.055182:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.055189:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.055191:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.056978:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.056989:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.057004:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.057008:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.057014:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.057027:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.057039:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.057047:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.057465:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788839493.058015:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.058022:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.058891:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.058895:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.058901:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.058923:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.058932:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.058940:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.058960:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788839493.058978:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839493.058984:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.058992:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.058996:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059005:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059023:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059228:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b6f6ce/0x4b63896d63640ebb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059259:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.059263:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059271:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.059274:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059282:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059293:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059300:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63640ec2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059312:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.059313:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.059315:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.059483:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839493.059874:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.059882:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059891:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.059894:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.059905:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059917:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059926:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059935:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.059958:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788839493.060368:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788839493.060374:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060383:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1788839493.060386:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839493.060390:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060398:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060405:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060423:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060438:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788839493.060448:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839493.060453:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060461:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.060465:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060475:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060488:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060496:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a68a552/0x4b63896d63640ec9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060511:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.060514:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060532:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.060535:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060542:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060564:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060572:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dadf1dfd/0x4b63896d63640ed0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.060587:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.060589:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.060591:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839493.060653:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839493.068772:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788839493.068791:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.068809:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1788839493.068814:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839493.068837:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.068854:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.068863:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.068871:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.068895:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839493.069271:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839493.069281:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839493.069290:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ca00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839493.069295:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839493.069304:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839493.069332:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839493.069341:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064a8c447/0x4b63896d63640ed7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839493.069362:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839493.069371:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839493.069373:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839493.069938:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788839493.069946:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.069957:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1788839493.069960:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839493.069965:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.069974:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.069983:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.070006:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839493.070030:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839493.070042:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839493.073655:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.073680:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839493.073686:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.073697:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.073744:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.073752:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64df2a5/0x4b63896d63640ede lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839493.073782:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.073784:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839493.073788:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788839493.074082:0:15055:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788839493.074195:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14394:x1875733747172608:12345-0@lo:5:osp-pre-0-0.0 Request processed in 191715us (192205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839493.074208:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839493.074884:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1875733747172608:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788839493.074904:0:14394:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788839493.074948:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1875733747172736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788839493.074990:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839493.075035:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839493.075082:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172736 00000100:00100000:2.0:1788839493.075089:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172736 00000100:00100000:2.0:1788839493.075129:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839493.075153:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14394:x1875733747172736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788839493.075198:0:15057:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788839493.087224:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14394:x1875733747172736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12080us (12228us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788839493.087234:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839493.087300:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1875733747172736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788839493.087315:0:14394:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:1.0:1788839493.093343:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788839493.379684:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839494.397353:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839495.421634:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839496.454803:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839497.469188:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839498.045998:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747172864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839498.046128:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839498.046240:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172864 00000100:00100000:2.0:1788839498.046249:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172864 00000100:00100000:2.0:1788839498.046318:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839498.046329:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875733747172864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839498.046374:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839498.046443:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875733747172864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839498.046451:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788839498.046486:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839498.046531:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747172864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839498.048487:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747172992:0@lo:400:kworker.0 00000100:00100000:0.0:1788839498.048555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839498.048635:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839498.048640:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788839498.048644:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839498.048649:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:2.0:1788839498.048653:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788839498.048659:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eb3707f800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1788839498.048682:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb330f5c00 x1875733747173120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839498.048785:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747173120:0@lo:8:kworker.0 00000100:00100000:2.0:1788839498.048824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839498.048863:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747173248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839498.048889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839498.048924:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839498.048930:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747173376:0@lo:400:kworker.0 00000100:00100000:2.0:1788839498.048953:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839498.048983:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747173248 00000100:00100000:2.0:1788839498.048990:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747173248 00000100:00100000:2.0:1788839498.049034:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747173376 00000100:00100000:2.0:1788839498.049038:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747173376 00000100:00100000:2.0:1788839498.049089:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839498.049098:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747173248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839498.049171:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747173248:12345-0@lo:400:kworker.0 Request processed in 73us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839498.049178:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839498.049197:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839498.049215:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747173376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839498.049243:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747173376:12345-0@lo:400:kworker.0 Request processed in 40us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839498.049249:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788839498.049289:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb330f4380 x1875733747173376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839498.049302:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747173376:0@lo:400:kworker.0 00010000:00080000:2.0:1788839498.049312:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb330f6a00 x1875733747173248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839498.049321:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747173248:0@lo:400:kworker.0 00000100:00080000:2.0:1788839498.049346:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839498.052361:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747173120 00000100:00100000:2.0:1788839498.052378:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747173120 00000100:00100000:2.0:1788839498.052426:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839498.052435:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875733747173120:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788839498.052458:0:15055:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788839498.059957:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747172992 00000100:00100000:0.0:1788839498.059975:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747172992 00000100:00100000:0.0:1788839498.060035:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788839498.060045:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3314:x1875733747172992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839498.060152:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3314:x1875733747172992:12345-0@lo:400:kworker.0 Request processed in 109us (11597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839498.060160:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788839498.062577:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747172992:0@lo:400:kworker.0 00000100:00100000:2.0:1788839498.112276:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875733747173120:12345-0@lo:8:kworker.0 Request processed in 59831us (63441us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788839498.112293:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788839498.112349:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839498.112370:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788839498.112374:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747173120:0@lo:8:kworker.0 00000001:00080000:1.0:1788839498.217193:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788839498.497163:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839499.517224:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839499.967762:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788839500.153973:0:15776:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788839500.153977:0:15776:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788839500.154219:0:15776:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91ea02e7f800 00000020:01000004:1.0:1788839500.154236:0:15776:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788839500.154250:0:15776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788839500.154263:0:15776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91eb3772b370) 00000020:00000080:1.0:1788839500.154280:0:15776:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788839500.175590:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788839500.175826:0:15776:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788839500.177594:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788839500.177850:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788839500.178321:0:15776:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788839500.178913:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:0.0:1788839500.179548:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 523: rc = 0 00100000:10000000:0.0:1788839500.179635:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 523: rc = 0 00100000:10000000:0.0:1788839500.180511:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 659: rc = 0 00100000:10000000:0.0:1788839500.180753:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 659: rc = 0 00100000:10000000:0.0:1788839500.180990:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 659: rc = 0 00100000:10000000:0.0:1788839500.181611:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 659: rc = 0 00100000:10000000:0.0:1788839500.182339:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 659: rc = 0 00100000:10000000:0.0:1788839500.182914:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 659: rc = 0 00000020:00000080:0.0:1788839500.183848:0:15776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788839500.183860:0:15776:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788839500.183871:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b63896d63640eec 00000020:01000004:0.0:1788839500.183879:0:15776:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788839500.183900:0:15776:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788839500.183903:0:15776:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788839500.183908:0:15776:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788839500.183932:0:15776:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788839500.183936:0:15776:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788839500.196896:0:15776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788839500.196938:0:15776:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.109@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788839500.196943:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788839500.196946:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839500.196947:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839500.196948:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839500.197217:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839500.197218:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839500.197219:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839500.197221:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839500.197222:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839500.197232:0:15776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788839500.197234:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839500.197235:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839500.197236:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839500.197237:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839500.197238:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839500.197239:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839500.197240:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839500.197241:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839500.197242:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839500.197270:0:15776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788839500.197292:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839500.197362:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.197572:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839500.197664:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747173504 00000100:00100000:2.0:1788839500.197671:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747173504 00000100:00100000:2.0:1788839500.197760:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788839500.197771:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15776:x1875733747173504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788839500.197802:0:14364:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788839500.197805:0:14364:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788839500.197810:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788839500.209565:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15776:x1875733747173504:12345-0@lo:253:mount.lustre.0 Request processed in 11785us (12191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.209580:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788839500.209661:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788839500.209675:0:15776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788839500.209678:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788839500.209680:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839500.209681:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839500.209683:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839500.209684:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839500.209685:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839500.209686:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839500.209688:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839500.209689:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788839500.209707:0:15776:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ea02e7f800 from lustre-OST0001 10000000:01000000:1.0:1788839500.209734:0:15776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788839500.209736:0:15776:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788839500.209747:0:15776:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eb3772cd28 local copy 00010000:00010000:1.0:1788839500.209758:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839500.210585:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839500.210637:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.210728:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839500.210789:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747173632 00000100:00100000:0.0:1788839500.210796:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747173632 00000100:00100000:0.0:1788839500.210882:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839500.210893:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15776:x1875733747173632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839500.211325:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15776:x1875733747173632:12345-0@lo:501:mount.lustre.0 Request processed in 433us (686us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839500.211334:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839500.211564:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173632:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788839500.211587:0:15776:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788839500.211749:0:15776:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788839500.211759:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839500.211770:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb102c7600/0x4b63896d63640c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640ca0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839500.211795:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ea02e7f800 10000000:01000000:2.0:1788839500.211800:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788839500.211805:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788839500.211807:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839500.211812:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788839500.211815:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788839500.211843:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09ebb600/0x4b63896d63640ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839500.211861:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09ebb600/0x4b63896d63640ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839500.211872:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09ebb600/0x4b63896d63640ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839500.211888:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839500.211923:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839500.212395:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb33079cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839500.212569:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747173760 00000100:00100000:1.0:1788839500.212576:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747173760 00000100:00100000:1.0:1788839500.212610:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839500.212619:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:15776:x1875733747173760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839500.212631:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839500.212644:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9da00/0x4b63896d63640efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640ef3 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.212666:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9da00/0x4b63896d63640efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640ef3 expref: 17 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.212677:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9da00/0x4b63896d63640efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640ef3 expref: 17 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.212686:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9da00, rc 0) 00000100:00100000:1.0:1788839500.212721:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747173760:12345-0@lo:101:mount.lustre.0 Request processed in 103us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.212728:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788839500.212806:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839500.212821:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09ebb600/0x4b63896d63640ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640efa expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839500.212830:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09ebb600/0x4b63896d63640ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640efa expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839500.213744:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788839500.215802:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839500.217287:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788839500.217355:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788839500.217682:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788839500.217733:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788839500.217772:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788839500.217806:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788839500.217881:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788839500.217889:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788839500.218325:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839500.218486:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839500.218546:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330799c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839500.218672:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747173888 00000100:00100000:1.0:1788839500.218679:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747173888 00000100:00100000:1.0:1788839500.218731:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788839500.218741:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747173888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839500.219634:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747173888:12345-0@lo:501:mount.lustre.0 Request processed in 892us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.219643:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839500.219843:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747173888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839500.219899:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839500.219999:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839500.220207:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839500.220279:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174016 00000100:00100000:3.0:1788839500.220285:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174016 00000100:00100000:3.0:1788839500.220353:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788839500.220361:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747174016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839500.220746:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747174016:12345-0@lo:503:mount.lustre.0 Request processed in 386us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839500.220754:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788839500.220823:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788839500.221720:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839500.221805:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839500.221850:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839500.222284:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839500.222764:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174144 00000100:00100000:0.0:1788839500.222773:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174144 00000100:00100000:0.0:1788839500.222814:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839500.222824:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747174144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839500.223119:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747174144:12345-0@lo:502:mount.lustre.0 Request processed in 295us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.223126:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788839500.223259:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839500.223527:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788839500.223579:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788839500.223615:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788839500.223664:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788839500.223704:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788839500.223739:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788839500.223790:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788839500.223825:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788839500.223873:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788839500.223907:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839500.223956:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839500.223988:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839500.224546:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174272 00000100:00100000:0.0:1788839500.224554:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174272 00000100:00100000:0.0:1788839500.224594:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788839500.224603:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747174272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839500.224812:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747174272:12345-0@lo:502:mount.lustre.0 Request processed in 209us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.224820:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839500.224927:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839500.225027:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788839500.225040:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788839500.226873:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788839500.226893:0:15778:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788839500.226900:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839500.226903:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788839500.226908:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839500.226923:0:15778:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91eb09e08000) 00000020:00000080:2.0:1788839500.226955:0:15778:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788839500.226962:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788839500.227079:0:15778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ea02e7f800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788839500.227088:0:15778:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788839500.227095:0:15778:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b63896d63640f08 00010000:00010000:2.0:1788839500.236761:0:15778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788839500.237622:0:15778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788839500.240246:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788839500.242742:0:15778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788839500.242758:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839500.242765:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839500.242768:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788839500.242772:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839500.242778:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839500.242780:0:15778:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788839500.242783:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839500.242785:0:15778:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788839500.242788:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839500.242791:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839500.242792:0:15778:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788839500.242795:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839500.242798:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839500.242800:0:15778:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788839500.242804:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788839500.242878:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839500.242882:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839500.242883:0:15778:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839500.242897:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788839500.243290:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788839500.243318:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788839500.243343:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09ebb600/0x4b63896d63640ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640efa expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.243355:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09ebb600/0x4b63896d63640ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640efa expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839500.243372:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ea02e7f800 from 1 10000000:01000000:3.0:1788839500.243375:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839500.243418:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.243435:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.243445:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839500.243470:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839500.243545:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839500.243596:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839500.243749:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174400 00000100:00100000:1.0:1788839500.243757:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174400 00000100:00100000:1.0:1788839500.243810:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788839500.243828:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:15776:x1875733747174400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839500.243841:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839500.243854:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640f0f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.243878:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640f0f expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.243889:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640f0f expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.243898:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d000, rc 0) 00000100:00100000:1.0:1788839500.243936:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174400:12345-0@lo:101:mount.lustre.0 Request processed in 110us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.243943:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788839500.244325:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839500.244341:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.244350:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839500.244964:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788839500.245875:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839500.246732:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788839500.246791:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788839500.246863:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788839500.246871:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788839500.247243:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839500.247309:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839500.247487:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839500.247723:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174528 00000100:00100000:1.0:1788839500.247731:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174528 00000100:00100000:1.0:1788839500.247815:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788839500.247825:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839500.248109:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174528:12345-0@lo:501:mount.lustre.0 Request processed in 285us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.248116:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788839500.248197:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839500.248233:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839500.248274:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839500.253293:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174656 00000100:00100000:0.0:1788839500.253308:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174656 00000100:00100000:0.0:1788839500.255502:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839500.255523:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839500.255911:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174656:12345-0@lo:503:mount.lustre.0 Request processed in 395us (7636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.255918:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788839500.256535:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839500.256569:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174656:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788839500.262236:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839500.262350:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839500.262541:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839500.262606:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839500.262699:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174784 00000100:00100000:2.0:1788839500.262708:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174784 00000100:00100000:2.0:1788839500.262767:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839500.262776:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839500.263147:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174784:12345-0@lo:502:mount.lustre.0 Request processed in 371us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839500.263154:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788839500.263618:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839500.263928:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788839500.263998:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788839500.264658:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788839500.264701:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788839500.264736:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788839500.264781:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788839500.264818:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788839500.264852:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788839500.264895:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839500.264978:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839500.265930:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0b0aa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839500.266908:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747174912 00000100:00100000:2.0:1788839500.266918:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747174912 00000100:00100000:2.0:1788839500.267259:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839500.267270:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839500.267637:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747174912:12345-0@lo:502:mount.lustre.0 Request processed in 369us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839500.267645:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788839500.267720:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747174912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839500.267865:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788839500.267883:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788839500.268975:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839500.268985:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839500.268992:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788839500.268999:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ea02e7f800 00000020:00000080:0.0:1788839500.269001:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839500.269203:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839500.269207:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839500.269208:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788839500.269211:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839500.269213:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839500.269214:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788839500.269217:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ea02e7f800 00000020:00000080:0.0:1788839500.269219:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839500.269312:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839500.269317:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839500.269318:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788839500.269321:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839500.269325:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839500.269326:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839500.269329:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ea02e7f800 00000020:00000080:0.0:1788839500.269331:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839500.276270:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839500.276285:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839500.276288:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788839500.276294:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788839500.284879:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788839500.284931:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839500.284965:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.284980:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839500.285548:0:15776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788839500.285552:0:15776:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ea02e7f800 10000000:01000000:1.0:1788839500.285556:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ea02e7f800 10000000:01000000:1.0:1788839500.285560:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839500.285567:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ea02e7f800 from 1 10000000:01000000:1.0:1788839500.285569:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839500.285613:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.285621:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.285631:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839500.285656:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839500.287497:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.287555:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839500.287661:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175040 00000100:00100000:0.0:1788839500.287671:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175040 00000100:00100000:0.0:1788839500.287730:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839500.287739:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747175040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839500.287755:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839500.287771:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ea01bef000/0x4b63896d63640f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640f1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839500.287798:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ea01bef000/0x4b63896d63640f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640f1d expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839500.287821:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ea01bef000/0x4b63896d63640f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640f1d expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839500.287832:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef000, rc 0) 00000100:00100000:0.0:1788839500.287885:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175040:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.287892:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839500.288523:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839500.288541:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f24 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.288550:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640f24 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839500.290204:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788839500.290778:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839500.291020:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788839500.291103:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788839500.291138:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788839500.291187:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788839500.291239:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788839500.291289:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788839500.291323:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788839500.291350:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788839500.291389:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788839500.291418:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788839500.291481:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788839500.291529:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788839500.291564:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788839500.291595:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788839500.291642:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788839500.291678:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788839500.291711:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788839500.291755:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788839500.291784:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788839500.291813:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788839500.291878:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788839500.291912:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788839500.291941:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788839500.291985:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788839500.292018:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788839500.292047:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788839500.292124:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788839500.292161:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788839500.292194:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788839500.292241:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788839500.292276:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788839500.292310:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788839500.292345:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788839500.292392:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788839500.296556:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788839500.296676:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788839500.296749:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788839500.296852:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788839500.296860:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788839500.296966:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839500.297209:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.297264:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175168 00000100:00100000:1.0:1788839500.297272:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175168 00000100:00100000:1.0:1788839500.297317:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788839500.297327:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839500.297633:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175168:12345-0@lo:501:mount.lustre.0 Request processed in 307us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.297642:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788839500.297690:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839500.297777:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839500.297812:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839500.297852:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.297876:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175296 00000100:00100000:1.0:1788839500.297880:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175296 00000100:00100000:1.0:1788839500.297904:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788839500.297911:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839500.298339:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175296:12345-0@lo:503:mount.lustre.0 Request processed in 428us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.298346:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788839500.298382:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839500.298395:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839500.301324:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839500.302284:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839500.302369:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.302528:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839500.306897:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175424 00000100:00100000:0.0:1788839500.306913:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175424 00000100:00100000:1.0:1788839500.311822:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788839500.311839:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839500.312378:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175424:12345-0@lo:502:mount.lustre.0 Request processed in 542us (10008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.312387:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788839500.314813:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839500.321762:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788839500.321856:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788839500.321892:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788839500.321944:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788839500.321983:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788839500.322215:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788839500.322255:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788839500.322292:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788839500.322342:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788839500.322381:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788839500.322418:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788839500.322497:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788839500.322533:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788839500.322565:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788839500.322626:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788839500.322662:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788839500.322691:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788839500.323254:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788839500.323303:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788839500.323338:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788839500.323388:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788839500.323436:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788839500.323473:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788839500.323523:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788839500.323560:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788839500.323595:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788839500.323642:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788839500.323696:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788839500.325358:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788839500.325444:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788839500.325484:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788839500.325520:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788839500.325556:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788839500.326254:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788839500.326302:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788839500.326351:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788839500.326389:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788839500.326437:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788839500.326487:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788839500.326521:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788839500.326573:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839500.326664:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839500.326781:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175552 00000100:00100000:0.0:1788839500.326789:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175552 00000100:00100000:0.0:1788839500.326839:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839500.326850:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839500.327118:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747175552:12345-0@lo:502:mount.lustre.0 Request processed in 269us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.327126:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788839500.327451:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0615de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839500.327475:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747175552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839500.327555:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788839500.327567:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788839500.328891:0:15787:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788839500.328909:0:15787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91eb40034d28) 00000020:00000080:3.0:1788839500.328931:0:15787:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788839500.329344:0:15787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ea02e7f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839500.329349:0:15787:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ea02e7f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839500.329352:0:15787:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ea02e7f800 3 00010000:00080000:2.0:1788839500.329387:0:15787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ea01ef2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.109@tcp at head 00010000:00010000:2.0:1788839500.333535:0:15787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788839500.333844:0:15787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788839500.333891:0:15787:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839500.333905:0:15787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b63896d63640f32 00000100:00080000:2.0:1788839500.333915:0:15787:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839500.333921:0:15787:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91ea01ef2000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1788839500.333961:0:15787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb330f5c00 x1875733747175680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839500.333996:0:15787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788839500.334342:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875733747175680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839500.334431:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839500.334661:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175680 00000100:00100000:2.0:1788839500.334669:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175680 00000100:00100000:2.0:1788839500.334715:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839500.334722:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875733747175680:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788839500.334745:0:14372:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1788839500.334777:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b63896d63640f39 00000004:00100000:2.0:1788839500.334792:0:14372:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788839500.334824:0:14372:0:(import.c:65:import_set_state_nolock()) ffff91ea01ef1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839500.334883:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875733747175680:12345-0@lo:38:llog_process_th.0 Request processed in 159us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839500.334891:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788839500.334932:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb330f5c00 x1875733747175680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839500.334944:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839500.334952:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788839500.334958:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788839500.334962:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788839500.334964:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91ea01ef2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788839500.334969:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875733747175680:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788839500.335367:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:1.0:1788839500.338114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839500.338121:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788839500.338135:0:37:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839500.338143:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788839500.338147:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788839500.338153:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eb3707f800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:1.0:1788839500.338180:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb37dcdf80 x1875733747175936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839500.338250:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747176064:0@lo:400:kworker.0 00000100:00100000:1.0:1788839500.338322:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.338373:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839500.338380:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747175808:0@lo:400:kworker.0 00000100:00100000:1.0:1788839500.338408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.338464:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175808 00000100:00100000:1.0:1788839500.338472:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175808 00000100:00100000:1.0:1788839500.338524:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839500.338534:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747175808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839500.338601:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747175808:12345-0@lo:400:kworker.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839500.338609:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839500.338647:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788839500.338666:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747175808:0@lo:400:kworker.0 00000020:01000000:1.0:1788839500.338687:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788839500.338732:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839500.338747:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f24 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.338758:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09c9d800/0x4b63896d63640f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f24 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788839500.338813:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788839500.338815:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839500.338816:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839500.338817:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839500.338819:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839500.338820:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839500.338821:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839500.338823:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839500.338824:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839500.338828:0:15776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788839500.338830:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839500.338831:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839500.338832:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839500.338833:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839500.338834:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839500.338835:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839500.338837:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839500.338838:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839500.338839:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839500.338852:0:15776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788839500.338862:0:15776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747176320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839500.338894:0:15776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.338919:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176320 00000100:00100000:1.0:1788839500.338923:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176320 00000100:00100000:1.0:1788839500.338950:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788839500.338957:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:15776:x1875733747176320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788839500.338978:0:14365:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788839500.338991:0:14365:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788839500.339389:0:15776:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839500.342272:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839500.342302:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747176192:0@lo:400:kworker.0 00000100:00100000:3.0:1788839500.342371:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839500.342437:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747175936:0@lo:8:kworker.0 00000100:00100000:3.0:1788839500.342467:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839500.342506:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747175936 00000100:00100000:3.0:1788839500.342515:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747175936 00000100:00100000:3.0:1788839500.342549:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839500.342556:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875733747175936:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788839500.342629:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875733747175936:12345-0@lo:8:kworker.0 Request processed in 67us (156us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788839500.342637:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839500.342677:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839500.342684:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839500.342689:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788839500.342692:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747175936:0@lo:8:kworker.0 00000100:00100000:0.0:1788839500.342978:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176064 00000100:00100000:0.0:1788839500.342983:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176064 00000100:00100000:0.0:1788839500.343033:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176192 00000100:00100000:0.0:1788839500.343037:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176192 00000100:00100000:0.0:1788839500.343083:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839500.343091:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747176064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839500.343147:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747176064:12345-0@lo:400:kworker.0 Request processed in 56us (4825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.343153:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839500.343169:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839500.343176:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747176192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839500.343214:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747176192:12345-0@lo:400:kworker.0 Request processed in 39us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839500.343221:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788839500.343375:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb37dcf800 x1875733747176192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839500.343387:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747176192:0@lo:400:kworker.0 00010000:00080000:1.0:1788839500.343489:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eb37dcd880 x1875733747176064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839500.343501:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747176064:0@lo:400:kworker.0 00000100:00080000:0.0:1788839500.344237:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839500.344244:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 20000000:01000000:3.0:1788839500.414274:0:14365:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788839500.414302:0:14365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788839500.414403:0:14387:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788839500.414409:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788839500.414441:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.414459:0:14387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640e13 expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.414469:0:14387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.414512:0:14387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d63640e13 expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839500.414528:0:14387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d63640e13 expref: 19 pid: 14366 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839500.414543:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14387:1875733747176448:0@lo:104: 00000100:00100000:1.0:1788839500.414610:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839500.414664:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0823fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839500.415435:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176448 00000100:00100000:3.0:1788839500.415446:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176448 00000100:00100000:3.0:1788839500.415514:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839500.415525:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14387:x1875733747176448:12345-0@lo:104: 00010000:00010000:3.0:1788839500.415539:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.415609:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839500.415615:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:14387:x1875733747176448:12345-0@lo:104: Request processed in 94us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839500.415623:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839500.415662:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14387:1875733747176448:0@lo:104: 00010000:00010000:3.0:1788839500.415682:0:14387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.415728:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839500.415733:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.415741:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9dc00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839500.415745:0:14360:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.415752:0:14360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839500.415760:0:14360:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839500.415765:0:14360:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839500.415797:0:14360:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.415803:0:14360:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839500.415821:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.415828:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb09c9dc00/0x4b63896d63640e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.415844:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839500.415846:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839500.415847:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839500.415865:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747176576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839500.415903:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839500.415954:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176576 00000100:00100000:3.0:1788839500.415958:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176576 00010000:00010000:3.0:1788839500.415975:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640e13 expref: 20 pid: 14366 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839500.415997:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839500.416199:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+20:3312:x1875733747176576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839500.416211:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839500.416216:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640e13 expref: 20 pid: 14366 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416227:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d63640e13 expref: 20 pid: 14366 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416240:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb102c6e00/0x4b63896d63640e1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d63640e13 expref: 20 pid: 14366 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416253:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416261:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788839500.416274:0:14356:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003011961s 00010000:00010000:3.0:1788839500.416278:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416285:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416301:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416307:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416313:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839500.416317:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416325:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416338:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416346:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839500.416377:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3312:x1875733747176576:12345-0@lo:103:ldlm_bl.0 Request processed in 375us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839500.416383:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788839500.416415:0:14387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416434:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839500.416440:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9d200/0x4b63896d63640f40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839500.416466:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747176576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839500.433464:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:15776:x1875733747176320:12345-0@lo:253:mount.lustre.0 Request processed in 94498us (94559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839500.433479:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788839500.433592:0:15776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:15776:1875733747176320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788839500.433609:0:15776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788839500.433613:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839500.433614:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788839500.433615:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839500.433616:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839500.433618:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839500.433619:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839500.433621:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788839500.433623:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839500.433624:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788839500.433641:0:15776:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788839500.446949:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839500.447437:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788839500.447597:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839500.447821:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788839500.447969:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788839500.448773:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788839500.450166:0:15776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788839500.523896:0:15776:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788839500.523906:0:15776:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788839500.523946:0:15776:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788839500.524033:0:15776:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788839500.524081:0:15776:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788839500.524111:0:15776:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788839500.548142:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839501.567435:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788839501.885228:0:14369:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788839501.885236:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ea02e78800 from 8 10000000:01000000:0.0:1788839501.885240:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839501.885286:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91ea01bee600/0x4b63896d63640f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.885298:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91ea01bee600/0x4b63896d63640f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.885310:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91ea01bee600/0x4b63896d63640f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839501.885337:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747176704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839501.885676:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839501.885730:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0c652e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839501.885748:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176704 00000100:00100000:0.0:1788839501.885755:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176704 00000100:00100000:0.0:1788839501.885800:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788839501.885809:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:14369:x1875733747176704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839501.885823:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839501.885910:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ea01bee000/0x4b63896d63640f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d63640f47 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.885934:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ea01bee000/0x4b63896d63640f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d63640f47 expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.885945:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ea01bee000/0x4b63896d63640f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640f47 expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.885955:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bee000, rc 0) 00000100:00100000:0.0:1788839501.886079:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747176704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 270us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839501.886087:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788839501.886139:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747176704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839501.886154:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91ea01bee600/0x4b63896d63640f47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f4e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.886163:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91ea01bee600/0x4b63896d63640f47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d63640f4e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839501.886215:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747176832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788839501.886247:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839501.886268:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0c652e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839501.886737:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176832 00000100:00100000:2.0:1788839501.886743:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176832 00000100:00100000:2.0:1788839501.886780:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788839501.886789:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747176832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788839501.886805:0:14365:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788839501.886824:0:14365:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788839501.887265:0:14365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788839501.887369:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747176832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 580us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839501.887377:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839501.887476:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747176832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788839501.887537:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839501.887544:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91ea01bee600/0x4b63896d63640f47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f4e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.887553:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91ea01bee600/0x4b63896d63640f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d63640f4e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.589243:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839503.165331:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747176960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839503.165424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839503.166266:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747176960 00000100:00100000:1.0:1788839503.166276:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747176960 00000100:00100000:1.0:1788839503.166338:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839503.166349:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747176960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839503.166399:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788839503.169252:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839503.173553:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747176960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7195us (8119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839503.173568:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839503.176518:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747176960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788839503.615406:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839504.638333:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.661210:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788839505.734800:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839505.734806:0:12628:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788839505.734810:0:12628:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839505.734823:0:12628:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eb3707f800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1788839505.734842:0:12628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eb0f8fa300 x1875733747177344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839505.734988:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747177088:0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735112:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.735159:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747177728:0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735304:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.735352:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839505.735358:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747177600:0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735381:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.735409:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747177216:0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735432:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.735451:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839505.735455:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747177472:0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.735501:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747177344:0@lo:8:kworker.0 00000100:00100000:3.0:1788839505.735525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.735556:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177728 00000100:00100000:3.0:1788839505.735563:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177728 00000100:00100000:3.0:1788839505.735608:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177600 00000100:00100000:3.0:1788839505.735619:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177600 00000100:00100000:3.0:1788839505.735633:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177472 00000100:00100000:3.0:1788839505.735635:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177472 00000100:00100000:3.0:1788839505.735649:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839505.735657:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747177728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735708:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875733747177728:12345-0@lo:400:kworker.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839505.735714:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839505.735729:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839505.735735:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747177600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735757:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875733747177600:12345-0@lo:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839505.735762:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839505.735770:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839505.735775:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747177472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735800:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747177472:12345-0@lo:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839505.735805:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839505.735825:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177216 00000100:00100000:3.0:1788839505.735828:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177216 00000100:00100000:3.0:1788839505.735850:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177344 00000100:00100000:3.0:1788839505.735853:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177344 00000100:00100000:3.0:1788839505.735863:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839505.735868:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747177216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.735907:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747177216:12345-0@lo:400:kworker.0 Request processed in 38us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839505.735912:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839505.735931:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839505.735935:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875733747177344:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788839505.735958:0:15057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:3.0:1788839505.735988:0:15057:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b63896d63640f55 00002000:00100000:3.0:1788839505.736001:0:15057:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91eb03102800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788839505.736005:0:15057:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788839505.736008:0:15057:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788839505.736440:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177088 00000100:00100000:0.0:1788839505.736445:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177088 00000100:00100000:0.0:1788839505.736476:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788839505.736484:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3314:x1875733747177088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839505.736525:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3314:x1875733747177088:12345-0@lo:400:kworker.0 Request processed in 42us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839505.736531:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00002000:00080000:3.0:1788839505.737492:0:15057:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788839505.737529:0:15057:0:(import.c:65:import_set_state_nolock()) ffff91eb03107800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839505.737588:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875733747177344:12345-0@lo:8:kworker.0 Request processed in 1651us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839505.737597:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788839505.737634:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839505.737640:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788839505.737678:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8fb100 x1875733747177472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839505.737692:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747177472:0@lo:400:kworker.0 00000100:00100000:3.0:1788839505.737706:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747177216:0@lo:400:kworker.0 00010000:00080000:3.0:1788839505.737739:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8faa00 x1875733747177600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839505.737748:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875733747177600:0@lo:400:kworker.0 00010000:00080000:0.0:1788839505.737877:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8fa300 x1875733747177344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788839505.737898:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788839505.737907:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788839505.737911:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788839505.737914:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91eb3707f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788839505.737934:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788839505.737939:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875733747177344:0@lo:8:kworker.0 00000100:00100000:3.0:1788839505.738256:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3314:1875733747177088:0@lo:400:kworker.0 00010000:00080000:3.0:1788839505.738270:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb0f8f8380 x1875733747177728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839505.738297:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875733747177728:0@lo:400:kworker.0 00000004:00080000:3.0:1788839505.738380:0:14396:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788839505.738397:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1875733747177984:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788839505.738445:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.738465:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb064440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839505.738477:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839505.738484:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747177856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839505.738506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839505.738540:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177856 00000100:00100000:3.0:1788839505.738546:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177856 00000100:00100000:3.0:1788839505.738586:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839505.738594:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747177856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839505.738623:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839505.738663:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875733747177856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839505.738670:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788839505.738689:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788839505.738705:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb37df3100 x1875733747177856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839505.738718:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747177856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839505.738735:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747177984 00000100:00100000:3.0:1788839505.738738:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747177984 00000004:00080000:2.0:1788839505.738885:0:14395:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788839505.739602:0:14395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 488430551441ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788839505.741447:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839505.741465:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14396:x1875733747177984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788839505.763675:0:15057:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788839505.763689:0:15057:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788839505.763696:0:15057:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788839505.785669:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.785681:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.785700:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.785708:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.785715:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.785733:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.785744:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.785752:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.785985:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.785998:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.786004:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786013:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.786018:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786028:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786084:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786093:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786143:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.786146:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.786147:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.786676:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.786682:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786692:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.786701:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.786705:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786715:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786723:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786729:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.786749:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839505.788437:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.788450:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788467:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.788471:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.788477:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788489:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788499:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788515:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788538:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788839505.788555:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839505.788561:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788569:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.788574:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788583:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788600:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788672:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b0651dd/0x4b63896d63640f63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788691:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.788695:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788713:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.788717:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788724:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788735:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788743:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d9bb9f6/0x4b63896d63640f6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.788757:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.788759:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.788760:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.789510:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.789519:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789530:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.789533:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.789538:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789549:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789565:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789572:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789592:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.789671:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.789678:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789797:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.789801:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789809:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789820:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789827:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c61bba87/0x4b63896d63640f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.789842:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.789849:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.789851:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.790416:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.792205:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.792216:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792229:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.792232:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.792236:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792245:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792252:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792257:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792270:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.792279:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.792283:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792288:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.792292:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792307:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792319:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792336:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001059898c/0x4b63896d63640f78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.792356:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.792358:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.792360:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.793361:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.793371:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793383:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.793386:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.793391:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793401:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793411:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793423:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793438:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.793448:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.793452:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793458:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebbc00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.793462:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793470:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793484:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793492:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005129574e/0x4b63896d63640f7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.793509:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.793511:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.793512:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.794416:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.794432:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794443:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.794446:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.794455:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794467:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794476:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794484:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794501:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839505.794891:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.794896:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794901:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.794903:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.794916:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794923:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794933:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794938:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794950:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788839505.794961:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839505.794965:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794971:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.794973:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794979:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794989:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.794993:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b40dbc16/0x4b63896d63640f86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795007:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.795014:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795018:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebac00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.795020:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795025:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795034:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795042:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d4f6041/0x4b63896d63640f8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795076:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.795079:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.795082:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.795481:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.795487:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795495:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.795498:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.795502:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795522:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795531:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795538:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795551:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.795559:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.795562:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795569:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09eba000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.795572:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795580:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795591:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795599:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb43d87b/0x4b63896d63640f94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.795620:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.795622:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.795623:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.796010:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.796016:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796024:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.796027:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.796032:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796042:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796075:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796083:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796099:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.796109:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.796113:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796132:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebb400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.796136:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796145:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796157:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796164:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9f93a34/0x4b63896d63640f9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796177:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.796179:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.796181:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.796592:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.796598:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796608:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.796612:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.796616:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796626:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796639:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796647:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796661:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.796669:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.796673:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796679:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebae00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.796683:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796690:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796700:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796707:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ebd236/0x4b63896d63640fa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.796722:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.796729:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.796731:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.797145:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.797151:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797158:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.797161:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.797165:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797173:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797180:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797186:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797199:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.797208:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.797212:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797219:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebbe00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.797222:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797240:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797252:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797260:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006582014b/0x4b63896d63640fa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.797276:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.797278:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.797281:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.798544:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.799019:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.799028:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799042:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.799046:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.799072:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799085:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799096:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799112:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799129:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.799141:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.799146:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799153:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09ebba00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.799156:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799165:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799178:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799186:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab12a609/0x4b63896d63640fb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799204:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.799205:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.799207:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.799781:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.799796:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799805:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.799809:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.799813:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799822:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799831:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799838:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799852:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839505.799861:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839505.799865:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799872:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839505.799876:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799883:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799901:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799978:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005de0e50e/0x4b63896d63640fb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.799993:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.799995:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.799997:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.800428:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.800434:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.800443:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.800446:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.800450:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.800460:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.800468:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.800476:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.800696:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839505.801543:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839505.801551:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.801566:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839505.801571:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.801580:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.801600:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.801607:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338653d2/0x4b63896d63640fbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.801630:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.801632:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.801634:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788839505.802308:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788839505.802751:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.802760:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.802774:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.802778:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.802784:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.802797:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.802807:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.802815:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.802841:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839505.802987:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839505.802994:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.803002:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.803006:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.803015:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.803032:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.803040:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000980a2465/0x4b63896d63640fc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.803081:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.803083:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.803084:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.803850:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.803857:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.803868:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.803878:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.803883:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.803895:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.803903:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.803978:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.803999:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839505.804125:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839505.804132:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.804140:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.804144:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.804160:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.804173:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.804180:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063c4cd69/0x4b63896d63640fcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.804195:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.804197:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.804199:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.804714:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.804721:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.804730:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.804733:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.804738:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.804748:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.804757:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.804771:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.804827:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839505.805251:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.805257:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.805265:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.805268:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.805272:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.805282:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.805290:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.805298:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805509:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839505.805516:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805533:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965400 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839505.805537:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805546:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805568:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805576:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e50d528b/0x4b63896d63640fd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805593:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839505.805596:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805612:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964a00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839505.805616:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805624:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805634:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.805641:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.805643:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.805645:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.806498:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788839505.806506:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c775c2/0x4b63896d63640fda lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839505.807107:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.807114:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.807124:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.807128:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.807132:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.807142:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.807151:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.807159:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.807350:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839505.807358:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.807365:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.807370:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.807379:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.807396:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.807418:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.807420:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.807423:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.807484:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788839505.807489:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d258f4/0x4b63896d63640fe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839505.807943:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.807950:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.807969:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.807972:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.807977:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.807986:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.807994:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.808002:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.808481:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839505.808488:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.808497:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.808501:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.808509:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.808522:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.808530:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.808532:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.808534:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.808678:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788839505.808684:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f66d4b15/0x4b63896d63640fe8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839505.809707:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.809715:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.809727:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.809730:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.809735:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.809757:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.809766:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.809774:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.809823:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839505.809831:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.809849:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965000 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839505.809853:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.809861:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.809874:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.809881:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.809883:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.809884:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.810334:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788839505.810341:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a6ea1ff/0x4b63896d63640fef lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839505.810852:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.810859:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.810869:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.810873:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.810878:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.810889:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.810921:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.810929:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.811113:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839505.811121:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.811129:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965200 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.811132:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.811148:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.811162:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.811170:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.811172:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.811174:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.811344:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788839505.811358:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af47515e/0x4b63896d63640ff6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839505.813400:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.813412:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.813414:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.813427:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.813431:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.813437:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.813449:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.813459:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.813473:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.813489:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839505.813510:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839505.813517:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.813526:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.813530:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.813539:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.813555:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.813562:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2d0bfb6/0x4b63896d63640ffd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.813592:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.813594:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.813595:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.814183:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.814190:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814198:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.814201:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.814205:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814213:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814220:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814227:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814283:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839505.814717:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.814724:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814739:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.814742:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.814746:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814755:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814764:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.814771:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814872:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839505.814879:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814887:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964800 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839505.814891:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814900:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814918:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814928:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ef45a7/0x4b63896d63641004 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814939:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839505.814941:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814946:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964c00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839505.814948:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814952:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814957:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839505.814964:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.814966:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839505.814967:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.815281:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788839505.815287:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6b3ea7b/0x4b63896d6364100b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.815684:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839505.815825:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.815831:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.815840:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.815843:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.815848:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.815868:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.815877:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.815884:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.815985:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839505.816404:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788839505.816410:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.816418:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788839505.816422:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839505.816426:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.816434:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.816441:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839505.816454:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816526:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839505.816531:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816536:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.816539:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816545:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816555:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816559:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf285bf/0x4b63896d63641012 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816572:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839505.816574:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816578:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965a00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:3.0:1788839505.816585:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816590:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816595:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839505.816599:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.816600:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839505.816601:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839505.816690:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788839505.816696:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f1dadc/0x4b63896d63641019 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788839505.816876:0:15057:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788839505.817093:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14396:x1875733747177984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 75631us (78645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839505.817103:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788839505.817197:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839505.819288:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1875733747177984:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788839505.819308:0:14396:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788839505.819507:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1875733747178112:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788839505.819562:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839505.819700:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb104f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839505.819821:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747178112 00000100:00100000:0.0:1788839505.819828:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747178112 00000100:00100000:0.0:1788839505.819882:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839505.819892:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14396:x1875733747178112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788839505.819950:0:15055:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788839505.826588:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14396:x1875733747178112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6691us (7020us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788839505.826669:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839505.827310:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1875733747178112:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788839505.827742:0:14396:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788839506.686640:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839507.710994:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839508.287604:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747178240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839508.287678:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839508.288181:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747178240 00000100:00100000:2.0:1788839508.288189:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747178240 00000100:00100000:2.0:1788839508.288426:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839508.288437:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747178240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839508.288471:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839508.288687:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747178240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 251us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839508.288706:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788839508.288741:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839508.289451:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747178240:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788839508.351750:0:16135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788839508.733326:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839509.181746:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788839509.757405:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839510.636690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839510.637092:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355136 00000100:00100000:2.0:1788839510.637106:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355136 00000100:00100000:2.0:1788839510.637153:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:2.0:1788839510.637162:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1875733729355136:12345-192.168.201.9@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788839510.637193:0:14365:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bd4e02a7-c776-47a2-b6e8-14e112fedfa2@192.168.201.9@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1788839510.637248:0:14365:0:(genops.c:1385:class_connect()) connect: client bd4e02a7-c776-47a2-b6e8-14e112fedfa2, cookie 0x4b63896d63641020 00000100:00080000:2.0:1788839510.637428:0:14365:0:(import.c:65:import_set_state_nolock()) ffff91ea01ef2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839510.637506:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+5:2354:x1875733729355136:12345-192.168.201.9@tcp:250:mount.lustre.0 Request processed in 343us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.637514:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:1.0:1788839510.663189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839510.663330:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355264 00000100:00100000:0.0:1788839510.663340:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355264 00000100:00100000:0.0:1788839510.663401:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:0.0:1788839510.663411:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+5:13748:x1875733729355264:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788839510.663430:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839510.663451:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ea01befa00/0x4b63896d63641027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2f6 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839510.663482:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ea01befa00/0x4b63896d63641027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2f6 expref: 6 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839510.663492:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ea01befa00/0x4b63896d63641027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2f6 expref: 6 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839510.663501:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01befa00, rc 0) 00000100:00100000:0.0:1788839510.663567:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+6:13748:x1875733729355264:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 156us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839510.663574:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:3.0:1788839510.669219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839510.670441:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355392 00000100:00100000:0.0:1788839510.670456:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355392 00000100:00100000:0.0:1788839510.670524:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:0.0:1788839510.670536:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+6:13748:x1875733729355392:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788839510.671252:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+6:13748:x1875733729355392:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 715us (2051us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839510.671274:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:3.0:1788839510.692441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839510.692969:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355520 00000100:00100000:2.0:1788839510.692979:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355520 00000100:00100000:2.0:1788839510.693586:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:2.0:1788839510.693600:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+6:13748:x1875733729355520:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788839510.693971:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839510.693994:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964a00/0x4b63896d6364102e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb2fd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839510.694026:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964a00/0x4b63896d6364102e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2fd expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839510.694036:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964a00/0x4b63896d6364102e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb2fd expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839510.694082:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964a00, rc 0) 00000100:00100000:2.0:1788839510.694191:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+7:13748:x1875733729355520:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 594us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.694199:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:1.0:1788839510.700566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839510.700773:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355648 00000100:00100000:0.0:1788839510.700783:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355648 00000100:00100000:0.0:1788839510.700844:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:0.0:1788839510.700855:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+7:13748:x1875733729355648:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788839510.701511:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13748:x1875733729355648:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 656us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839510.701519:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:3.0:1788839510.704132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839510.704252:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355776 00000100:00100000:2.0:1788839510.704261:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355776 00000100:00100000:2.0:1788839510.704323:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:2.0:1788839510.704333:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13748:x1875733729355776:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788839510.704700:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13748:x1875733729355776:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 367us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.704708:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:3.0:1788839510.716469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839510.716953:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729355904 00000100:00100000:0.0:1788839510.716964:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729355904 00000100:00100000:0.0:1788839510.717035:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:0.0:1788839510.717046:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13768:x1875733729355904:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788839510.720828:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13768:x1875733729355904:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 3773us (4357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839510.720841:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:0.0:1788839510.751147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.751271:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356032 00000100:00100000:1.0:1788839510.751283:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356032 00000100:00100000:1.0:1788839510.751354:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:1.0:1788839510.751365:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13768:x1875733729356032:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839510.751816:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13768:x1875733729356032:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 452us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.751834:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:0.0:1788839510.762840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.764410:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356160 00000100:00100000:1.0:1788839510.764433:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356160 00000100:00100000:1.0:1788839510.764488:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:1.0:1788839510.764498:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+8:13748:x1875733729356160:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788839510.764513:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839510.764532:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9dc00/0x4b63896d63641035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb327 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839510.764560:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9dc00/0x4b63896d63641035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb327 expref: 9 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839510.764572:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9dc00/0x4b63896d63641035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb327 expref: 9 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839510.764581:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9dc00, rc 0) 00000100:00100000:1.0:1788839510.764643:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+9:13748:x1875733729356160:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 147us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.764650:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:3.0:1788839510.767927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.768332:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356288 00000100:00100000:1.0:1788839510.768343:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356288 00000100:00100000:1.0:1788839510.768396:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:1.0:1788839510.768406:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb052b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+9:13748:x1875733729356288:12345-192.168.201.9@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788839510.768536:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788839510.768563:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788839510.768567:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788839510.768571:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788839510.768573:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788839510.773746:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb052b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+9:13748:x1875733729356288:12345-192.168.201.9@tcp:256:mount.lustre.0 Request processed in 5330us (5818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839510.773761:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:0.0:1788839510.777887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839510.777988:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356416 00000100:00100000:2.0:1788839510.777998:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356416 00000100:00100000:2.0:1788839510.778095:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:2.0:1788839510.778106:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+9:13748:x1875733729356416:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788839510.778124:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839510.778141:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb32e expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839510.778168:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 10 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839510.778180:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 10 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839510.778189:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965e00, rc 0) 00000100:00100000:2.0:1788839510.778758:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13748:x1875733729356416:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 652us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.778767:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 85 00010000:00010000:3.0:1788839510.791117:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839510.799113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839510.799279:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356544 00000100:00100000:0.0:1788839510.799290:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356544 00000100:00100000:0.0:1788839510.799353:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:0.0:1788839510.799364:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13748:x1875733729356544:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788839510.799667:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13748:x1875733729356544:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 304us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839510.799676:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:1.0:1788839510.804616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839510.804719:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356672 00000100:00100000:2.0:1788839510.804730:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356672 00000100:00100000:2.0:1788839510.804790:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:2.0:1788839510.804801:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13748:x1875733729356672:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788839510.805151:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13748:x1875733729356672:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 350us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.805159:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:3.0:1788839510.820665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.821188:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356800 00000100:00100000:1.0:1788839510.821199:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356800 00000100:00100000:1.0:1788839510.821270:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:1.0:1788839510.821282:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13773:x1875733729356800:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839510.821571:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13773:x1875733729356800:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 290us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.821579:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:3.0:1788839510.828523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839510.828915:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729356928 00000100:00100000:0.0:1788839510.828927:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729356928 00000100:00100000:0.0:1788839510.828991:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00100000:0.0:1788839510.829001:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13773:x1875733729356928:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788839510.829298:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13773:x1875733729356928:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 298us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839510.829307:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00100000:0.0:1788839510.838208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839510.839331:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357056 00000100:00100000:3.0:1788839510.839344:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357056 00000100:00100000:3.0:1788839510.839447:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:3.0:1788839510.839457:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2354:x1875733729357056:12345-192.168.201.9@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788839510.839488:0:14659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5875ff00-b531-42d6-8f43-f0e838002ea7@192.168.201.9@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:3.0:1788839510.839537:0:14659:0:(genops.c:1385:class_connect()) connect: client 5875ff00-b531-42d6-8f43-f0e838002ea7, cookie 0x4b63896d63641043 00000004:00100000:3.0:1788839510.839567:0:14659:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788839510.839573:0:14659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788839510.847449:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839510.847472:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747178368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839510.847537:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839510.847600:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747178368 00000100:00100000:3.0:1788839510.847607:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747178368 00000100:00100000:3.0:1788839510.847656:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839510.847665:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747178368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839510.847698:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839510.847740:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875733747178368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839510.847748:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788839510.847768:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839510.847804:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747178368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839510.849128:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747178624:0@lo:400:kworker.0 00000100:00100000:2.0:1788839510.849178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839510.849230:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839510.849246:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747178752:0@lo:400:kworker.0 00000100:00100000:2.0:1788839510.849273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839510.849313:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747178624 00000100:00100000:2.0:1788839510.849319:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747178624 00000100:00100000:2.0:1788839510.849367:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839510.849376:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747178624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839510.849594:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747178624:12345-0@lo:400:kworker.0 Request processed in 218us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.849602:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839510.849625:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747178752 00000100:00100000:2.0:1788839510.849629:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747178752 00000100:00100000:2.0:1788839510.849654:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839510.849660:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747178752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839510.849703:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875733747178752:12345-0@lo:400:kworker.0 Request processed in 43us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.849709:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788839510.849732:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788839510.849755:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb330f6d80 x1875733747178752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839510.849767:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875733747178752:0@lo:400:kworker.0 00000100:00100000:2.0:1788839510.849779:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747178624:0@lo:400:kworker.0 00000100:00100000:1.0:1788839510.849853:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747178880:0@lo:400:kworker.0 00000100:00100000:1.0:1788839510.849883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839510.849910:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788839510.849916:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747178496:0@lo:400:kworker.0 00000100:00100000:1.0:1788839510.849943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839510.849968:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747179008:0@lo:400:kworker.0 00000100:00100000:1.0:1788839510.849992:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839510.850016:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747178496 00000100:00100000:1.0:1788839510.850020:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747178496 00000100:00100000:1.0:1788839510.850043:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839510.850074:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3313:x1875733747178496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839510.850107:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3313:x1875733747178496:12345-0@lo:400:kworker.0 Request processed in 58us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.850113:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839510.850147:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747178880 00000100:00100000:1.0:1788839510.850151:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747178880 00000100:00100000:1.0:1788839510.850174:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179008 00000100:00100000:1.0:1788839510.850177:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179008 00000100:00100000:1.0:1788839510.850190:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839510.850196:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747178880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839510.850247:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747178880:12345-0@lo:400:kworker.0 Request processed in 50us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.850252:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839510.850262:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839510.850268:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747179008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839510.850290:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747179008:12345-0@lo:400:kworker.0 Request processed in 23us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.850295:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788839510.850309:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839510.850322:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747178496:0@lo:400:kworker.0 00010000:00080000:1.0:1788839510.850332:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb330f5500 x1875733747179008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839510.850340:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747179008:0@lo:400:kworker.0 00010000:00080000:1.0:1788839510.850348:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eb330f5c00 x1875733747178880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839510.850355:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747178880:0@lo:400:kworker.0 00000100:00080000:2.0:1788839510.914894:0:14659:0:(import.c:65:import_set_state_nolock()) ffff91ea01ef7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839510.914981:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2354:x1875733729357056:12345-192.168.201.9@tcp:38:mount.lustre.0 Request processed in 75523us (76782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.914992:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:1.0:1788839510.951112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.951153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.951187:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357184 00000100:00100000:1.0:1788839510.951208:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357184 00000100:00100000:1.0:1788839510.951268:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357312 00000100:00100000:1.0:1788839510.951272:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357312 00000100:00100000:1.0:1788839510.951292:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:1.0:1788839510.951301:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:0:x1875733729357184:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788839510.951341:0:14373:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788839510.951417:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:0:x1875733729357184:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 117us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.951438:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:1.0:1788839510.951456:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:1.0:1788839510.951463:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13748:x1875733729357312:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788839510.951474:0:14373:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788839510.951497:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13748:x1875733729357312:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839510.951504:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00080000:1.0:1788839510.951521:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839510.957284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839510.957519:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357440 00000100:00100000:2.0:1788839510.957529:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357440 00000100:00100000:2.0:1788839510.957588:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1788839510.957598:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13748:x1875733729357440:12345-192.168.201.9@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788839510.957688:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13748:x1875733729357440:12345-192.168.201.9@tcp:40:mount.lustre.0 Request processed in 92us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.957696:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1788839510.964730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.964782:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839510.964843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839510.965168:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357824 00000100:00100000:2.0:1788839510.965178:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357824 00000100:00100000:2.0:1788839510.965271:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:2.0:1788839510.965281:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13748:x1875733729357824:12345-192.168.201.9@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788839510.965369:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357568 00000100:00100000:2.0:1788839510.965383:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357568 00000100:00100000:2.0:1788839510.965403:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357696 00000100:00100000:2.0:1788839510.965406:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357696 00000100:00100000:2.0:1788839510.965611:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1788839510.965620:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875733729357568:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788839510.965647:0:15057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5875ff00-b531-42d6-8f43-f0e838002ea7@192.168.201.9@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1788839510.965678:0:15057:0:(genops.c:1385:class_connect()) connect: client 5875ff00-b531-42d6-8f43-f0e838002ea7, cookie 0x4b63896d6364104a 00002000:00100000:2.0:1788839510.965689:0:15057:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5875ff00-b531-42d6-8f43-f0e838002ea7/ffff91eb033e8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788839510.965711:0:15057:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788839510.966203:0:15057:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788839510.966303:0:15057:0:(import.c:65:import_set_state_nolock()) ffff91eb033ef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839510.966411:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2354:x1875733729357568:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 789us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.966529:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1788839510.966555:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1788839510.966560:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875733729357696:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788839510.966577:0:15057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5875ff00-b531-42d6-8f43-f0e838002ea7@192.168.201.9@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1788839510.966594:0:15057:0:(genops.c:1385:class_connect()) connect: client 5875ff00-b531-42d6-8f43-f0e838002ea7, cookie 0x4b63896d63641051 00002000:00100000:2.0:1788839510.966601:0:15057:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5875ff00-b531-42d6-8f43-f0e838002ea7/ffff91eb033eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788839510.966607:0:15057:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788839510.966859:0:15057:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788839510.966875:0:15057:0:(import.c:65:import_set_state_nolock()) ffff91eb033eb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839510.966902:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2354:x1875733729357696:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 339us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839510.966909:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000004:00080000:3.0:1788839510.969543:0:14374:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4192us 00000004:00200000:2.0:1788839511.019882:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788839511.020000:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13748:x1875733729357824:12345-192.168.201.9@tcp:33:mount.lustre.0 Request processed in 54715us (55274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839511.020011:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000001:00080000:3.0:1788839511.040360:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788839511.040438:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788839511.373439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839511.373549:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729357952 00000100:00100000:2.0:1788839511.373560:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729357952 00000100:00100000:2.0:1788839511.373646:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:2.0:1788839511.373665:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13794:x1875733729357952:12345-192.168.201.9@tcp:101:mkdir.0 00010000:00010000:2.0:1788839511.373686:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839511.373712:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d63641058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb358 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839511.373789:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d6364105f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839511.373802:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d6364105f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839511.373827:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d6364105f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839511.373863:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788839511.373867:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839511.373915:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d6364105f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839511.373942:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964400/0x4b63896d63641058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb358 expref: 8 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839511.373960:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d6364105f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb358 expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839511.373982:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:2.0:1788839511.373986:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839511.373989:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964600, rc 0) 00000100:00100000:2.0:1788839511.374097:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+7:13794:x1875733729357952:12345-192.168.201.9@tcp:101:mkdir.0 Request processed in 434us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839511.374105:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00010000:00010000:0.0:1788839511.806575:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839512.830319:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839513.406812:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747179136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839513.406890:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839513.406974:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179136 00000100:00100000:1.0:1788839513.406981:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179136 00000100:00100000:1.0:1788839513.407041:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839513.407067:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747179136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839513.407136:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839513.407197:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747179136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839513.407206:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788839513.407229:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839513.407270:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747179136:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788839513.506388:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5875ff00-b531-42d6-8f43-f0e838002ea7 00000100:00100000:2.0:1788839513.622427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839513.627632:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358080 00000100:00100000:1.0:1788839513.627647:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358080 00000100:00100000:1.0:1788839513.627740:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:1.0:1788839513.627754:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:13846:x1875733729358080:12345-192.168.201.9@tcp:41:lfs.0 00000004:00000024:1.0:1788839513.627807:0:14373:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788839513.627905:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:13846:x1875733729358080:12345-192.168.201.9@tcp:41:lfs.0 Request processed in 154us (5503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839513.627913:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00080000:2.0:1788839513.629350:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839513.634690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839513.635859:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358208 00000100:00100000:3.0:1788839513.635872:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358208 00000100:00100000:3.0:1788839513.635958:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:3.0:1788839513.635969:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5875ff00-b531-42d6-8f43-f0e838002ea7+5:13846:x1875733729358208:12345-192.168.201.9@tcp:13:lfs.0 00002000:00000024:3.0:1788839513.635994:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839513.636127:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5875ff00-b531-42d6-8f43-f0e838002ea7+5:13846:x1875733729358208:12345-192.168.201.9@tcp:13:lfs.0 Request processed in 159us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839513.636136:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00080000:2.0:1788839513.636271:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839513.641459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839513.641569:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358336 00000100:00100000:3.0:1788839513.641578:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358336 00000100:00100000:3.0:1788839513.641648:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1788839513.641659:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13846:x1875733729358336:12345-192.168.201.9@tcp:13:lfs.0 00002000:00000024:3.0:1788839513.641697:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788839513.641835:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839513.641907:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5875ff00-b531-42d6-8f43-f0e838002ea7+6:13846:x1875733729358336:12345-192.168.201.9@tcp:13:lfs.0 Request processed in 249us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839513.641914:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1788839513.839410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.840131:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358464 00000100:00100000:2.0:1788839513.840145:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358464 00000100:00100000:2.0:1788839513.840248:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:2.0:1788839513.840260:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+10:13879:x1875733729358464:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788839513.840282:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839513.840306:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964400/0x4b63896d63641066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb35f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.840346:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964400/0x4b63896d63641066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb35f expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.840359:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964400/0x4b63896d63641066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb35f expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.840369:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964400, rc 0) 00000100:00100000:2.0:1788839513.840453:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13879:x1875733729358464:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 195us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.840478:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:0.0:1788839513.850740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.852405:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358592 00000100:00100000:2.0:1788839513.852425:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358592 00000100:00100000:2.0:1788839513.852515:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:2.0:1788839513.852539:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13879:x1875733729358592:12345-192.168.201.9@tcp:501:mount.lustre.0 00010000:00010000:3.0:1788839513.853207:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839513.854079:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13879:x1875733729358592:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 1519us (3319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.854093:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:0.0:1788839513.864836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839513.864938:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358720 00000100:00100000:1.0:1788839513.864951:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358720 00000100:00100000:1.0:1788839513.865038:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:1.0:1788839513.865087:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13879:x1875733729358720:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788839513.865463:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13879:x1875733729358720:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 414us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839513.865472:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:1.0:1788839513.868960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.872875:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358848 00000100:00100000:2.0:1788839513.872896:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358848 00000100:00100000:2.0:1788839513.873360:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:2.0:1788839513.873376:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13885:x1875733729358848:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839513.873821:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13885:x1875733729358848:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 449us (4873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.873831:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:0.0:1788839513.895783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.900211:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729358976 00000100:00100000:2.0:1788839513.900230:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729358976 00000100:00100000:2.0:1788839513.900313:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:2.0:1788839513.900321:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13885:x1875733729358976:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839513.900658:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13885:x1875733729358976:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 337us (4884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.900665:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:0.0:1788839513.903581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.903678:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729359104 00000100:00100000:2.0:1788839513.903687:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729359104 00000100:00100000:2.0:1788839513.903764:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 96 00000100:00100000:2.0:1788839513.903776:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13879:x1875733729359104:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788839513.904323:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839513.904345:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20964000/0x4b63896d6364106d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb389 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.904388:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20964000/0x4b63896d6364106d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb389 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.904401:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20964000/0x4b63896d6364106d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb389 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.904411:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964000, rc 0) 00000100:00100000:2.0:1788839513.904465:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13879:x1875733729359104:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 692us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.904472:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 96 00000100:00100000:0.0:1788839513.907811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.908106:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729359232 00000100:00100000:2.0:1788839513.908117:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729359232 00000100:00100000:2.0:1788839513.908256:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:2.0:1788839513.908271:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13879:x1875733729359232:12345-192.168.201.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788839513.908308:0:14364:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788839513.908334:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788839513.908337:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788839513.908340:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788839513.908342:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788839513.910152:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13879:x1875733729359232:12345-192.168.201.9@tcp:256:mount.lustre.0 Request processed in 1870us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.910175:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:0.0:1788839513.913119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.913201:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729359360 00000100:00100000:2.0:1788839513.913216:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729359360 00000100:00100000:2.0:1788839513.913278:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:2.0:1788839513.913285:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13879:x1875733729359360:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788839513.913299:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839513.913314:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb390 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.913336:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 13 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.913345:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 13 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839513.913352:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965000, rc 0) 00000100:00100000:2.0:1788839513.913458:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13879:x1875733729359360:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 173us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.913463:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:0.0:1788839513.914873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.915041:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729359488 00000100:00100000:2.0:1788839513.915124:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729359488 00000100:00100000:2.0:1788839513.915224:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:2.0:1788839513.915235:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13879:x1875733729359488:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788839513.915544:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13879:x1875733729359488:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 311us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.915550:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:0.0:1788839513.917027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.917289:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729359616 00000100:00100000:2.0:1788839513.917300:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729359616 00000100:00100000:2.0:1788839513.917374:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:2.0:1788839513.917404:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13879:x1875733729359616:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788839513.917619:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13879:x1875733729359616:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 223us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.917625:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:0.0:1788839513.919633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.919777:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729359744 00000100:00100000:2.0:1788839513.919786:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729359744 00000100:00100000:2.0:1788839513.919838:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:2.0:1788839513.919848:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13889:x1875733729359744:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839513.920231:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13889:x1875733729359744:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 382us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.920240:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:0.0:1788839513.926459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.927381:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729359872 00000100:00100000:2.0:1788839513.927399:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729359872 00000100:00100000:2.0:1788839513.927492:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:2.0:1788839513.927505:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13889:x1875733729359872:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839513.928792:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13889:x1875733729359872:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 1278us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.928805:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:0.0:1788839513.934221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.934959:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360000 00000100:00100000:2.0:1788839513.934975:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360000 00000100:00100000:2.0:1788839513.935046:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1788839513.935080:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1875733729360000:12345-192.168.201.9@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788839513.935122:0:14372:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b27e0999-0c92-4e01-8851-8f25a699b1ef@192.168.201.9@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:2.0:1788839513.935307:0:14372:0:(genops.c:1385:class_connect()) connect: client b27e0999-0c92-4e01-8851-8f25a699b1ef, cookie 0x4b63896d6364107b 00000004:00100000:2.0:1788839513.935361:0:14372:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788839513.935530:0:14372:0:(import.c:65:import_set_state_nolock()) ffff91eb40283800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839513.935696:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2354:x1875733729360000:12345-192.168.201.9@tcp:38:mount.lustre.0 Request processed in 613us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839513.935708:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1788839513.943272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839513.943338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839513.943397:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360256 00000100:00100000:1.0:1788839513.943430:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360256 00000100:00100000:1.0:1788839513.943538:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360128 00000100:00100000:1.0:1788839513.943541:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360128 00000100:00100000:3.0:1788839513.943551:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1788839513.943582:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+7:13879:x1875733729360256:12345-192.168.201.9@tcp:41:mount.lustre.0 00000100:00080000:2.0:1788839513.943620:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788839513.943622:0:14371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788839513.943762:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+7:13879:x1875733729360256:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 198us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839513.947652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839513.947675:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1788839513.947853:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360384 00000100:00100000:3.0:1788839513.947861:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360384 00000100:00100000:3.0:1788839513.947901:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:3.0:1788839513.947922:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+7:0:x1875733729360128:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788839513.947951:0:14371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788839513.948009:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+7:0:x1875733729360128:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 88us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839513.948015:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:3.0:1788839513.948027:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1788839513.948032:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:13879:x1875733729360384:12345-192.168.201.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788839513.948077:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:13879:x1875733729360384:12345-192.168.201.9@tcp:40:mount.lustre.0 Request processed in 44us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839513.948083:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1788839513.953496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.953545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839513.953583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839513.953671:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360512 00000100:00100000:0.0:1788839513.953680:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360512 00000100:00100000:0.0:1788839513.953722:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360640 00000100:00100000:0.0:1788839513.953725:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360640 00000100:00100000:0.0:1788839513.953739:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1788839513.953747:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875733729360512:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788839513.953780:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b27e0999-0c92-4e01-8851-8f25a699b1ef@192.168.201.9@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1788839513.953810:0:15055:0:(genops.c:1385:class_connect()) connect: client b27e0999-0c92-4e01-8851-8f25a699b1ef, cookie 0x4b63896d63641082 00002000:00100000:0.0:1788839513.953823:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b27e0999-0c92-4e01-8851-8f25a699b1ef/ffff91eb0339a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788839513.953834:0:15055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788839513.954110:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788839513.954144:0:15055:0:(import.c:65:import_set_state_nolock()) ffff91eb3bf5b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839513.954223:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2354:x1875733729360512:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 475us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839513.954231:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1788839513.954248:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:0.0:1788839513.954254:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875733729360640:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788839513.954268:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b27e0999-0c92-4e01-8851-8f25a699b1ef@192.168.201.9@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1788839513.954282:0:15055:0:(genops.c:1385:class_connect()) connect: client b27e0999-0c92-4e01-8851-8f25a699b1ef, cookie 0x4b63896d63641089 00002000:00100000:0.0:1788839513.954288:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b27e0999-0c92-4e01-8851-8f25a699b1ef/ffff91eb3bf5a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788839513.954294:0:15055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788839513.954344:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788839513.954359:0:15055:0:(import.c:65:import_set_state_nolock()) ffff91eb3bf5d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839513.954397:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2354:x1875733729360640:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 142us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839513.954404:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:1.0:1788839513.955731:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360768 00000100:00100000:1.0:1788839513.955741:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360768 00000100:00100000:1.0:1788839513.955798:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:1.0:1788839513.955808:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:13879:x1875733729360768:12345-192.168.201.9@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788839513.955886:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788839513.955961:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:13879:x1875733729360768:12345-192.168.201.9@tcp:33:mount.lustre.0 Request processed in 155us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839513.955968:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:2.0:1788839514.191641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839514.191725:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729360896 00000100:00100000:3.0:1788839514.191736:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729360896 00000100:00100000:3.0:1788839514.191809:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:3.0:1788839514.191821:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:13910:x1875733729360896:12345-192.168.201.9@tcp:101:mkdir.0 00010000:00010000:3.0:1788839514.191842:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839514.191867:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3ba expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.191932:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.191945:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.191957:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839514.192008:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788839514.192013:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839514.192034:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.192091:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.192111:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.192120:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:3.0:1788839514.192123:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839514.192127:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f200, rc 0) 00000100:00100000:3.0:1788839514.192201:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+7:13910:x1875733729360896:12345-192.168.201.9@tcp:101:mkdir.0 Request processed in 383us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839514.192217:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00010000:00010000:0.0:1788839514.880072:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839515.902440:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839515.965399:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747179264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839515.965495:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839515.965601:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179264 00000100:00100000:1.0:1788839515.965611:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179264 00000100:00100000:1.0:1788839515.965677:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788839515.965687:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747179264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839515.965724:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788839515.965768:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747179264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839515.965775:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788839515.965810:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788839515.965845:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747179264:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788839515.966041:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839515.970022:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747179392:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.970117:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839515.970216:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179392 00000100:00100000:0.0:1788839515.970225:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179392 00000100:00100000:0.0:1788839515.970270:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839515.970279:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3313:x1875733747179392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.970498:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3313:x1875733747179392:12345-0@lo:400:kworker.0 Request processed in 219us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839515.970508:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839515.970563:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747179392:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.970607:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747179520:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.970937:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839515.970982:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179520 00000100:00100000:0.0:1788839515.970987:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179520 00000100:00100000:0.0:1788839515.971027:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839515.971037:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747179520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.971110:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747179520:12345-0@lo:400:kworker.0 Request processed in 76us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839515.971118:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839515.971157:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747179520:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.971191:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839515.971370:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747179648:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.971400:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839515.971428:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179648 00000100:00100000:0.0:1788839515.971432:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179648 00000100:00100000:0.0:1788839515.971458:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839515.971465:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747179648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.971499:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875733747179648:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839515.971506:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839515.971534:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875733747179648:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.971570:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747179776:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.971601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839515.971630:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179776 00000100:00100000:0.0:1788839515.971633:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179776 00000100:00100000:0.0:1788839515.971661:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839515.971668:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747179776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.971940:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747179776:12345-0@lo:400:kworker.0 Request processed in 272us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839515.971947:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839515.971978:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747179776:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.972012:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747179904:0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.972040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839515.972091:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747179904 00000100:00100000:0.0:1788839515.972096:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747179904 00000100:00100000:0.0:1788839515.972121:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788839515.972126:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747179904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839515.972177:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875733747179904:12345-0@lo:400:kworker.0 Request processed in 50us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839515.972183:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788839515.972190:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839515.972195:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839515.972221:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0f8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875733747179904:0@lo:400:kworker.0 00000001:00100000:2.0:1788839515.999763:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b27e0999-0c92-4e01-8851-8f25a699b1ef 00000001:00100000:2.0:1788839515.999874:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5875ff00-b531-42d6-8f43-f0e838002ea7 00000001:00100000:3.0:1788839516.015621:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b27e0999-0c92-4e01-8851-8f25a699b1ef 00000001:00100000:3.0:1788839516.015640:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5875ff00-b531-42d6-8f43-f0e838002ea7 00010000:00010000:3.0:1788839516.925305:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839517.406766:0:16339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788839517.949441:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839518.525527:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747180032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839518.525665:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839518.525977:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180032 00000100:00100000:2.0:1788839518.525985:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180032 00000100:00100000:2.0:1788839518.526047:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839518.526075:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747180032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839518.526118:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788839518.526166:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747180032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839518.526173:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788839518.528230:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839518.528316:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747180032:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788839518.592423:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b27e0999-0c92-4e01-8851-8f25a699b1ef 00010000:00010000:0.0:1788839518.976170:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839519.289160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839519.289200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839519.289223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839519.289246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839519.289263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839519.289284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839519.289307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839519.289330:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361408 00000100:00100000:0.0:1788839519.289340:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361408 00000100:00100000:0.0:1788839519.289395:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361664 00000100:00100000:0.0:1788839519.289398:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361664 00000100:00100000:0.0:1788839519.289414:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361280 00000100:00100000:0.0:1788839519.289416:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361280 00000100:00100000:0.0:1788839519.289427:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361792 00000100:00100000:0.0:1788839519.289429:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361792 00000100:00100000:0.0:1788839519.289444:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1788839519.289453:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2356:x1875733729361408:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839519.289647:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361152 00000100:00100000:3.0:1788839519.289652:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361152 00000100:00100000:3.0:1788839519.289744:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361536 00000100:00100000:3.0:1788839519.289748:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361536 00000100:00100000:3.0:1788839519.289772:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1788839519.289780:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2356:x1875733729361152:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839519.289848:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2356:x1875733729361152:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 68us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839519.289862:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1788839519.289880:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:3.0:1788839519.289887:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2356:x1875733729361536:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839519.289912:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2356:x1875733729361536:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839519.289917:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1788839519.289980:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2356:x1875733729361408:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 528us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839519.289988:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1788839519.290002:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:0.0:1788839519.290009:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2356:x1875733729361664:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839519.290035:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2356:x1875733729361664:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839519.290042:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:0.0:1788839519.290570:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:0.0:1788839519.290578:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2356:x1875733729361280:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839519.290606:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2356:x1875733729361280:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 29us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839519.290613:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:0.0:1788839519.290625:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:0.0:1788839519.290632:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2356:x1875733729361792:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839519.290654:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2356:x1875733729361792:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 23us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839519.290660:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1788839519.291149:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361024 00000100:00100000:1.0:1788839519.291157:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361024 00000100:00100000:1.0:1788839519.291198:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:1.0:1788839519.291206:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:2356:x1875733729361024:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1788839519.291237:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:2356:x1875733729361024:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 32us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839519.291243:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00080000:0.0:1788839519.291377:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839519.291383:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839519.291385:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1788839519.421863:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839519.997251:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839521.021547:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839521.085481:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747180288:0@lo:400:kworker.0 00000100:00100000:0.0:1788839521.085576:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839521.085649:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747180800:0@lo:400:kworker.0 00000100:00100000:0.0:1788839521.085679:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839521.085705:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788839521.085711:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747180160:0@lo:400:kworker.0 00000100:00100000:0.0:1788839521.085748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839521.085787:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747180672:0@lo:400:kworker.0 00000100:00100000:0.0:1788839521.085812:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839521.086003:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180160 00000100:00100000:2.0:1788839521.086013:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180160 00000100:00100000:2.0:1788839521.086131:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788839521.086142:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3312:x1875733747180160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839521.086184:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747180544:0@lo:400:kworker.0 00000100:00100000:2.0:1788839521.086197:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3312:x1875733747180160:12345-0@lo:400:kworker.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839521.086211:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839521.086214:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839521.086234:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839521.086240:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747180416:0@lo:400:kworker.0 00000100:00100000:1.0:1788839521.086262:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839521.086285:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180288 00000100:00100000:1.0:1788839521.086288:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180288 00000100:00100000:1.0:1788839521.086335:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180416 00000100:00100000:1.0:1788839521.086339:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180416 00000100:00100000:1.0:1788839521.086355:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839521.086361:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747180288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839521.086392:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875733747180288:12345-0@lo:400:kworker.0 Request processed in 32us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839521.086398:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839521.086411:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788839521.086416:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747180416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839521.086469:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747180416:12345-0@lo:400:kworker.0 Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839521.086475:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788839521.086492:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180800 00000100:00100000:1.0:1788839521.086495:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180800 00000100:00100000:2.0:1788839521.086507:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747180160:0@lo:400:kworker.0 00000100:00100000:2.0:1788839521.086523:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875733747180288:0@lo:400:kworker.0 00000100:00100000:1.0:1788839521.086869:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180672 00000100:00100000:1.0:1788839521.086873:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180672 00000100:00100000:1.0:1788839521.086889:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180544 00000100:00100000:1.0:1788839521.086891:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180544 00000100:00100000:2.0:1788839521.086939:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839521.086948:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747180800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839521.086988:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875733747180800:12345-0@lo:400:kworker.0 Request processed in 41us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839521.086994:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839521.087008:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839521.087014:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747180672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839521.087040:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875733747180672:12345-0@lo:400:kworker.0 Request processed in 26us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839521.087046:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839521.087215:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839521.087250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839521.087282:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747180928 00000100:00100000:3.0:1788839521.087286:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747180928 00000100:00100000:3.0:1788839521.087313:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839521.087322:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747180928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839521.087346:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839521.087380:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747180928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839521.087386:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788839521.087542:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839521.087548:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839521.087550:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839521.087582:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747180416:0@lo:400:kworker.0 00000100:00100000:1.0:1788839521.088102:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747180544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839521.088323:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747180544:12345-0@lo:400:kworker.0 Request processed in 1238us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839521.088331:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747180544:0@lo:400:kworker.0 00000100:00100000:0.0:1788839521.088369:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875733747180672:0@lo:400:kworker.0 00000100:00100000:0.0:1788839521.088383:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875733747180800:0@lo:400:kworker.0 00000100:00100000:3.0:1788839521.088503:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839521.098389:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839521.099259:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788839522.046398:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788839522.067774:0:16487:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0423faf0 20000000:00000080:2.0:1788839522.067795:0:16487:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eb4151f400 uarg=0000000000000000 20000000:01000000:2.0:1788839522.067833:0:16487:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788839522.067839:0:16487:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788839522.067843:0:16487:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788839522.069168:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788839522.069368:0:16487:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788839522.076335:0:16487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788839522.076468:0:16487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076484:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640d8e expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076543:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640ddb expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076562:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d63640f0f expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076568:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076572:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076577:0:16487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076666:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.076680:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 12 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839522.076695:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181056:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839522.077502:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.077511:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 12 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839522.077519:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03109f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181184:192.168.201.9@tcp:104: 00010000:00010000:3.0:1788839522.077560:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d63640f0f expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.077576:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d63640f0f expref: 18 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839522.077582:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181312:0@lo:104: 00000100:00100000:3.0:1788839522.077614:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839522.077653:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d63640ddb expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.077659:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d63640ddb expref: 18 pid: 14364 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839522.077665:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181440:0@lo:104: 00000100:00100000:3.0:1788839522.077678:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839522.077700:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747181312 00000100:00100000:3.0:1788839522.077715:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747181312 00000100:00100000:3.0:1788839522.077766:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747181440 00000100:00100000:3.0:1788839522.077770:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747181440 00000100:00100000:3.0:1788839522.077785:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839522.077794:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+4:16487:x1875733747181312:12345-0@lo:104: 00010000:00010000:3.0:1788839522.077807:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.077846:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839522.077851:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+4:16487:x1875733747181312:12345-0@lo:104: Request processed in 59us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839522.077856:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839522.077868:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839522.077872:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:16487:x1875733747181440:12345-0@lo:104: 00010000:00010000:3.0:1788839522.077894:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.077919:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788839522.077923:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:16487:x1875733747181440:12345-0@lo:104: Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839522.077927:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788839522.077940:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839522.077945:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.077959:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ea00 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839522.077962:0:14359:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.077968:0:14359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839522.077973:0:14359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839522.077977:0:14359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839522.077997:0:14359:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078001:0:14359:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839522.078016:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078023:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d63640f0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640f16 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078075:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839522.078080:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078086:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c7200 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:3.0:1788839522.078089:0:14359:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078096:0:14359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839522.078101:0:14359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839522.078106:0:14359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839522.078120:0:14359:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078126:0:14359:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839522.078142:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078147:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb102c7200/0x4b63896d63640ddb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640de2 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078155:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839522.078156:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839522.078158:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839522.078163:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839522.078178:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb0310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747181568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839522.078199:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839522.078221:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747181568 00000100:00100000:3.0:1788839522.078223:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747181568 00010000:00010000:3.0:1788839522.078237:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640f0f expref: 19 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839522.078251:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839522.078255:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3313:x1875733747181568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839522.078262:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839522.078265:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640f0f expref: 19 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078272:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d63640f0f expref: 19 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839522.078283:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839522.078514:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747181568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839522.079013:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839522.079022:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839522.079042:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747181696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839522.079575:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b63896d63640d8e expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.079587:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b63896d63640d8e expref: 19 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839522.079612:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181824:0@lo:104: 00000100:00100000:2.0:1788839522.079660:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839522.079690:0:16487:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb01254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839522.079852:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788839522.079865:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747181824 00000100:00100000:1.0:1788839522.079869:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747181824 00000100:00100000:1.0:1788839522.079934:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839522.079942:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40622450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:16487:x1875733747181824:12345-0@lo:104: 00010000:00010000:1.0:1788839522.079962:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839522.080008:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839522.080013:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40622450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+3:16487:x1875733747181824:12345-0@lo:104: Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839522.080020:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788839522.080103:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839522.080109:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839522.080117:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb102c6600 already unused, calling callback (ffffffffc1a36c20) 10000000:00010000:1.0:1788839522.080121:0:14360:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839522.080129:0:14360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839522.080136:0:14360:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839522.080141:0:14360:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839522.080168:0:14360:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839522.080175:0:14360:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839522.080194:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839522.080200:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff91eb102c6600/0x4b63896d63640d8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b63896d63640d95 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839522.080217:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839522.080219:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839522.080221:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839522.080227:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839522.080236:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3311:1875733747181952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839522.080266:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839522.080613:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9d000/0x4b63896d63640f16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d63640f0f expref: 19 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839522.080633:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181312:0@lo:104: 00000100:00100000:2.0:1788839522.080651:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181440:0@lo:104: 00000100:00100000:2.0:1788839522.080658:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181824:0@lo:104: 00000100:00100000:1.0:1788839522.081147:0:14358:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788839522.081158:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788839522.081848:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747181952 00000100:00100000:2.0:1788839522.081858:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747181952 00010000:00010000:2.0:1788839522.081899:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d8e expref: 19 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839522.082102:0:14358:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788839522.082117:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839522.082126:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3311:x1875733747181952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839522.082139:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839522.082146:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640d8e expref: 19 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.082156:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d63640d8e expref: 19 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.082172:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09ebb000/0x4b63896d63640d95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d63640d8e expref: 19 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.082197:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839522.082259:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:3311:x1875733747181952:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839522.082267:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839522.082428:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3311:1875733747181952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839522.083499:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:3313:x1875733747181568:12345-0@lo:103:ldlm_bl.0 Request processed in 5228us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839522.083510:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839522.083750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839522.084114:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747181696 00000100:00100000:2.0:1788839522.084123:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747181696 00010000:00010000:2.0:1788839522.084154:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640ddb expref: 17 pid: 14364 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839522.084195:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839522.084205:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb10278850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:3312:x1875733747181696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839522.084219:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839522.084225:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b63896d63640ddb expref: 17 pid: 14364 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.084236:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b63896d63640ddb expref: 17 pid: 14364 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.084254:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb09c9c800/0x4b63896d63640de2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b63896d63640ddb expref: 17 pid: 14364 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.084268:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839522.084322:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb10278850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:3312:x1875733747181696:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839522.084329:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839522.084676:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3312:1875733747181696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839522.087629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839522.087829:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb0310a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181056:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839522.087843:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03109f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875733747181184:192.168.201.9@tcp:104: 00010000:00010000:2.0:1788839522.087914:0:16487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839522.088224:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729361920 00000100:00100000:0.0:1788839522.088230:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729361920 00010000:00010000:0.0:1788839522.088260:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 13 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839522.088376:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1788839522.088385:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:2357:x1875733729361920:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839522.088400:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839522.088407:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 13 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.088418:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 13 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.088437:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20965000/0x4b63896d63641074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb390 expref: 13 pid: 14366 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.088453:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839522.088510:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:2357:x1875733729361920:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 126us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839522.088515:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1788839522.088700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839522.089430:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362048 00000100:00100000:2.0:1788839522.089437:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362048 00010000:00010000:2.0:1788839522.089464:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 12 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839522.089603:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:2.0:1788839522.089613:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:2357:x1875733729362048:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839522.089625:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839522.089630:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 12 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089652:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 12 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089665:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20965e00/0x4b63896d6364103c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb32e expref: 12 pid: 14365 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089679:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089688:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089704:0:14358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089724:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089731:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089738:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089743:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6ee00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:2.0:1788839522.089747:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089754:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089788:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839522.089798:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839522.089848:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:2357:x1875733729362048:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 237us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839522.089855:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00010000:00010000:0.0:1788839522.089920:0:16487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839522.089928:0:16487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839522.089934:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eb20a6ee00/0x4b63896d6364109e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.069809:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839523.515945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839523.516300:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362176 00000100:00100000:1.0:1788839523.516312:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362176 00000100:00100000:1.0:1788839523.516366:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:1.0:1788839523.516376:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+11:13763:x1875733729362176:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839523.516394:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839523.516415:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9d600/0x4b63896d636410a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3c1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.516452:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9d600/0x4b63896d636410a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3c1 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.516464:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9d600/0x4b63896d636410a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3c1 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.516472:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d600, rc 0) 00000100:00100000:1.0:1788839523.516524:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13763:x1875733729362176:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 149us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839523.516531:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:1.0:1788839523.521432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839523.521532:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362304 00000100:00100000:2.0:1788839523.521542:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362304 00000100:00100000:2.0:1788839523.521590:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:2.0:1788839523.521600:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13763:x1875733729362304:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839523.524535:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13763:x1875733729362304:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 2925us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839523.524549:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:2.0:1788839523.543943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839523.544180:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362432 00000100:00100000:3.0:1788839523.544191:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362432 00000100:00100000:3.0:1788839523.544248:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 108 00000100:00100000:3.0:1788839523.544259:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13763:x1875733729362432:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.544485:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13763:x1875733729362432:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 227us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839523.544493:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 108 10000000:01000000:1.0:1788839523.581861:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788839523.581870:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ea02e7f800 from 10 10000000:01000000:1.0:1788839523.581876:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839523.582276:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9ca00/0x4b63896d636410ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.582307:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb09c9ca00/0x4b63896d636410ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.582319:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb09c9ca00/0x4b63896d636410ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839523.582344:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839523.582417:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839523.582472:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05914900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839523.583855:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182080 00000100:00100000:0.0:1788839523.583867:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182080 00000100:00100000:0.0:1788839523.583942:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839523.583955:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+16:14369:x1875733747182080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839523.583972:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839523.583988:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ea01beea00/0x4b63896d636410b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d636410ac expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.584281:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ea01beea00/0x4b63896d636410b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d636410ac expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.584294:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ea01beea00/0x4b63896d636410b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d636410ac expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.584302:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01beea00, rc 0) 00000100:00100000:0.0:1788839523.584372:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:14369:x1875733747182080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839523.584379:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839523.586169:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb33769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839523.586838:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb09c9ca00/0x4b63896d636410ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410b3 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.586853:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb09c9ca00/0x4b63896d636410ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d636410b3 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839523.586949:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37577b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839523.587299:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839523.587345:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839523.587753:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182208 00000100:00100000:3.0:1788839523.587767:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182208 00000100:00100000:3.0:1788839523.587813:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788839523.587822:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:14369:x1875733747182208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839523.588157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839523.588273:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362560 00000100:00100000:0.0:1788839523.588277:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362560 00000100:00100000:0.0:1788839523.588299:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 111 00000100:00100000:0.0:1788839523.588307:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+12:13763:x1875733729362560:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839523.588317:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839523.588334:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ea01bef400/0x4b63896d636410ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3c8 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.588360:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ea01bef400/0x4b63896d636410ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3c8 expref: 13 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.588371:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ea01bef400/0x4b63896d636410ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3c8 expref: 13 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839523.588380:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef400, rc 0) 00000100:00100000:0.0:1788839523.588437:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13763:x1875733729362560:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 130us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839523.588444:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 111 00000100:00100000:3.0:1788839523.590906:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:14369:x1875733747182208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3076us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839523.590919:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839523.592424:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37577b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839523.592497:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839523.592565:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839523.592618:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb05914000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839523.593189:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182336 00000100:00100000:3.0:1788839523.593198:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182336 00000100:00100000:3.0:1788839523.593251:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788839523.593261:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:14369:x1875733747182336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.593473:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:14369:x1875733747182336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839523.593481:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788839523.593529:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3376a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788839523.596172:0:16533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788839523.596499:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788839523.596527:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839523.596539:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb09c9ca00/0x4b63896d636410ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410b3 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839523.596551:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb09c9ca00/0x4b63896d636410ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410b3 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839523.596563:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788839523.596566:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eb106cd000 from 10 10000000:01000000:3.0:1788839523.596569:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839523.596610:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d636410c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839523.596631:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d636410c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839523.596643:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d636410c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839523.596684:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.596755:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839523.596803:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839523.597736:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182464 00000100:00100000:1.0:1788839523.597747:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182464 00000100:00100000:1.0:1788839523.597793:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788839523.597802:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+17:14369:x1875733747182464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839523.597818:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839523.597832:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb09c9c000/0x4b63896d636410c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d636410c1 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.597856:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb09c9c000/0x4b63896d636410c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d636410c1 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.597866:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb09c9c000/0x4b63896d636410c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d636410c1 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839523.597885:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9c000, rc 0) 00000100:00100000:1.0:1788839523.597942:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:14369:x1875733747182464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839523.597949:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788839523.598407:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839523.598427:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d636410c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410c8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839523.598437:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d636410c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d636410c8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839523.598505:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.598540:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839523.598573:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839523.598757:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182592 00000100:00100000:1.0:1788839523.598762:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182592 00000100:00100000:1.0:1788839523.598786:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788839523.598793:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:14369:x1875733747182592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839523.599212:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:14369:x1875733747182592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 418us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839523.599219:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788839523.602462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839523.603207:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362688 00000100:00100000:1.0:1788839523.603217:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362688 00000100:00100000:1.0:1788839523.603267:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:1.0:1788839523.603277:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13763:x1875733729362688:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839523.603578:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13763:x1875733729362688:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 301us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839523.603586:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:2.0:1788839523.607742:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.608144:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.612269:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839523.612314:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182720 00000100:00100000:3.0:1788839523.612321:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182720 00000100:00100000:3.0:1788839523.612367:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788839523.612377:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:14369:x1875733747182720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.612580:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:14369:x1875733747182720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839523.612595:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788839523.612654:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10a50780 going to sleep for 11 seconds 00000100:00100000:3.0:1788839523.612677:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788839523.614691:0:16537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788839523.614826:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788839523.614846:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839523.614857:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d636410c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410c8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.614868:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20a6ea00/0x4b63896d636410c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410c8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839523.614879:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839523.614895:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ea02e78800 from 10 10000000:01000000:2.0:1788839523.614898:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839523.614933:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d636410cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.614941:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d636410cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.614951:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d636410cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839523.614975:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839523.615075:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839523.615111:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182848 00000100:00100000:2.0:1788839523.615118:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182848 00000100:00100000:2.0:1788839523.615161:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788839523.615169:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+18:14369:x1875733747182848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839523.615190:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839523.615204:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eb20965000/0x4b63896d636410d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b63896d636410cf expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.615226:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eb20965000/0x4b63896d636410d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b63896d636410cf expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.615237:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eb20965000/0x4b63896d636410d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b63896d636410cf expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.615244:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965000, rc 0) 00000100:00100000:2.0:1788839523.615276:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747182848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839523.615292:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788839523.615337:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839523.615356:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839523.615368:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d636410cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410d6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.615377:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d636410cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b63896d636410d6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839523.615421:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839523.615446:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839523.615465:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747182976 00000100:00100000:2.0:1788839523.615469:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747182976 00000100:00100000:2.0:1788839523.615489:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788839523.615494:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747182976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839523.615746:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747182976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839523.615754:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788839523.615777:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839523.615788:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747182976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839523.615813:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747183104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839523.615850:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839523.615868:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747183104 00000100:00100000:2.0:1788839523.615871:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747183104 00000100:00100000:2.0:1788839523.615891:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788839523.615904:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747183104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839523.616078:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:14369:x1875733747183104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839523.616085:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788839523.616114:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839523.616126:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb330f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:14369:1875733747183104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839523.617251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839523.617364:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362816 00000100:00100000:3.0:1788839523.617374:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362816 00000100:00100000:3.0:1788839523.617942:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:3.0:1788839523.617955:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13763:x1875733729362816:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839523.618230:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:13763:x1875733729362816:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 277us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839523.618239:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 120 00000040:00080000:1.0:1788839523.618867:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788839523.619395:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788839523.619416:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839523.619428:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d636410cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410d6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839523.619441:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff91eb20965e00/0x4b63896d636410cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b63896d636410d6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839523.651585:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747183232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839523.651735:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839523.651808:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747183232 00000100:00100000:2.0:1788839523.651816:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747183232 00000100:00100000:2.0:1788839523.651884:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788839523.651894:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747183232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839523.651943:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788839523.652018:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839523.659909:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747183232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8007us (8165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839523.659923:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839523.660832:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747183232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839524.097325:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839524.409007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839524.409372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839524.409462:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729363072 00000100:00100000:2.0:1788839524.409472:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729363072 00000100:00100000:2.0:1788839524.409533:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1788839524.409542:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2358:x1875733729363072:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839524.409628:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2358:x1875733729363072:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 87us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839524.409653:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00080000:0.0:1788839524.410073:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839524.410711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839524.415832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839524.415866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839524.416273:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729363200 00000100:00100000:2.0:1788839524.416285:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729363200 00000100:00100000:2.0:1788839524.416348:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729363456 00000100:00100000:2.0:1788839524.416351:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729363456 00000100:00100000:2.0:1788839524.416373:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839524.416385:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2357:x1875733729363200:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839524.416473:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2357:x1875733729363200:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 89us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839524.416481:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839524.416500:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1788839524.416507:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2357:x1875733729363456:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839524.416533:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2357:x1875733729363456:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839524.416540:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00080000:1.0:1788839524.417696:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839524.417705:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839524.426856:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729363328 00000100:00100000:3.0:1788839524.426872:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729363328 00000100:00100000:3.0:1788839524.426950:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729362944 00000100:00100000:3.0:1788839524.426955:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729362944 00000100:00100000:3.0:1788839524.426985:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:3.0:1788839524.427005:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2358:x1875733729363328:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839524.427126:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2358:x1875733729363328:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 130us (17753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839524.427133:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:3.0:1788839524.427153:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:3.0:1788839524.427160:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2357:x1875733729362944:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839524.427185:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2357:x1875733729362944:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (16480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839524.427190:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00080000:3.0:1788839524.427235:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839524.427292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839524.427842:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729363584 00000100:00100000:3.0:1788839524.427849:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729363584 00000100:00100000:3.0:1788839524.427894:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1788839524.427903:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2358:x1875733729363584:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1788839524.427944:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2358:x1875733729363584:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 42us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839524.427951:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00080000:3.0:1788839524.427972:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788839525.117436:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839526.141333:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839526.205527:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747183744:0@lo:400:kworker.0 00000100:00100000:1.0:1788839526.205597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839526.205655:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788839526.205660:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747183360:0@lo:400:kworker.0 00000100:00100000:1.0:1788839526.205685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839526.205703:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747183872:0@lo:400:kworker.0 00000100:00100000:1.0:1788839526.205720:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839526.205739:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747183488:0@lo:400:kworker.0 00000100:00100000:1.0:1788839526.205759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839526.205772:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747184000:0@lo:400:kworker.0 00000100:00100000:1.0:1788839526.205787:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839526.205799:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839526.205803:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747183616:0@lo:400:kworker.0 00000100:00100000:1.0:1788839526.205819:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839526.206092:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747183360 00000100:00100000:2.0:1788839526.206101:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747183360 00000100:00100000:2.0:1788839526.206148:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788839526.206158:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3313:x1875733747183360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839526.206215:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3313:x1875733747183360:12345-0@lo:400:kworker.0 Request processed in 59us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839526.206222:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788839526.206251:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747183488 00000100:00100000:2.0:1788839526.206254:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747183488 00000100:00100000:2.0:1788839526.206278:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747183616 00000100:00100000:2.0:1788839526.206292:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747183616 00000100:00100000:2.0:1788839526.206307:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839526.206313:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747183488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839526.206345:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747183488:12345-0@lo:400:kworker.0 Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839526.206351:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839526.206360:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839526.206366:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747183616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839526.206388:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747183616:12345-0@lo:400:kworker.0 Request processed in 23us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839526.206394:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839526.206434:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747183616:0@lo:400:kworker.0 00000100:00100000:2.0:1788839526.206443:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747183488:0@lo:400:kworker.0 00000100:00100000:2.0:1788839526.206466:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3313:1875733747183360:0@lo:400:kworker.0 00000100:00100000:0.0:1788839526.206730:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747183744 00000100:00100000:0.0:1788839526.206735:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747183744 00000100:00100000:0.0:1788839526.206760:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747183872 00000100:00100000:0.0:1788839526.206762:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747183872 00000100:00100000:0.0:1788839526.206772:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747184000 00000100:00100000:0.0:1788839526.206774:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747184000 00000100:00100000:0.0:1788839526.206786:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839526.206792:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747183744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839526.206825:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875733747183744:12345-0@lo:400:kworker.0 Request processed in 34us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839526.206831:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839526.206842:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839526.206847:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747183872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839526.206867:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875733747183872:12345-0@lo:400:kworker.0 Request processed in 20us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839526.206873:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839526.206881:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839526.206886:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747184000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839526.206906:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747184000:12345-0@lo:400:kworker.0 Request processed in 20us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839526.206911:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788839526.207755:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839526.207761:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839526.207764:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839526.208901:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747184000:0@lo:400:kworker.0 00000100:00100000:2.0:1788839526.208924:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839526.208973:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747184128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839526.209047:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839526.209126:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875733747183872:0@lo:400:kworker.0 00000100:00100000:2.0:1788839526.209138:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875733747183744:0@lo:400:kworker.0 00000100:00100000:3.0:1788839526.209861:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747184128 00000100:00100000:3.0:1788839526.209870:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747184128 00000100:00100000:3.0:1788839526.209916:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839526.209926:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747184128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839526.209973:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839526.210078:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875733747184128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839526.210086:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839526.210148:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747184128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839526.894306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839526.896570:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729363712 00000100:00100000:0.0:1788839526.896588:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729363712 00000100:00080000:3.0:1788839526.896760:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839526.898721:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:0.0:1788839526.898748:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+6:14422:x1875733729363712:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839526.898774:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839526.898801:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d636410dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.898911:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.898926:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.898941:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.898967:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.898975:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.898982:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899365:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befc00/0x4b63896d636410f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899375:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befc00/0x4b63896d636410f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899383:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befc00/0x4b63896d636410f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839526.899409:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839526.899412:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839526.899449:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befc00/0x4b63896d636410f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899471:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899478:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899484:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899489:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839526.899493:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899500:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899513:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:0.0:1788839526.899516:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839526.899521:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899528:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636410e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899554:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899561:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899568:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899580:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01befe00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839526.899583:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899589:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899598:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91eb10996e00) 00010000:00010000:0.0:1788839526.899600:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839526.899603:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899610:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d636410eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899645:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d636410dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3cf expref: 8 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899659:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befc00/0x4b63896d636410f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3cf expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839526.899667:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eb10996c00) 00010000:00010000:0.0:1788839526.899669:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839526.899672:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01befc00, rc 0) 00000100:00100000:0.0:1788839526.899749:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+7:14422:x1875733729363712:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1012us (5453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839526.899758:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:1.0:1788839526.920384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839526.920485:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729363968 00000100:00100000:3.0:1788839526.920497:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729363968 00000100:00100000:3.0:1788839526.920568:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1788839526.920580:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:14422:x1875733729363968:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839526.920601:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839526.920645:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636410f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3d6 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.920723:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.920739:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.920750:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.920814:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.920822:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.920828:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921237:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364110e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921246:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364110e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921253:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364110e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839526.921262:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788839526.921474:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921492:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921499:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921505:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839526.921509:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921518:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921530:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eb10996c00) 00010000:00010000:3.0:1788839526.921533:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839526.921537:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921543:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641100 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921557:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921563:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921569:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921573:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839526.921582:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921589:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921597:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91eb20904900) 00010000:00010000:3.0:1788839526.921599:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839526.921602:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.921607:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641107 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.922134:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636410f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3d6 expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.922151:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6ee00/0x4b63896d6364110e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3d6 expref: 9 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839526.922159:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb20904d00) 00010000:00010000:3.0:1788839526.922161:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839526.922164:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6ee00, rc 0) 00000100:00100000:3.0:1788839526.922245:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14422:x1875733729363968:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1667us (1870us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788839526.922253:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1788839526.943040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839526.943178:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729364096 00000100:00100000:1.0:1788839526.943188:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729364096 00000100:00100000:1.0:1788839526.943242:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:1.0:1788839526.943254:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14422:x1875733729364096:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788839526.943404:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14422:x1875733729364096:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 Request processed in 150us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839526.943412:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:1.0:1788839527.009441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839527.009580:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729364224 00000100:00100000:3.0:1788839527.009591:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729364224 00000100:00100000:3.0:1788839527.009652:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1788839527.009679:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14428:x1875733729364224:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839527.009701:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839527.009723:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364111c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3dd expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.009794:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.009808:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.009820:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.009833:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.009839:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.009845:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010037:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010045:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010080:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010097:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839527.010101:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010119:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010132:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:3.0:1788839527.010135:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839527.010139:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010145:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010158:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010164:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010170:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010176:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839527.010178:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010184:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010202:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eb20904900) 00010000:00010000:3.0:1788839527.010204:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839527.010208:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010214:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d6364112a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010247:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364111c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3dd expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010256:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:3.0:1788839527.010258:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839527.010261:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364111c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3dd expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.010269:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e600, rc 0) 00000100:00100000:3.0:1788839527.010337:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14428:x1875733729364224:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 661us (907us total) trans 0 rc 301/301 00000100:00100000:3.0:1788839527.010344:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:2.0:1788839527.021443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839527.021680:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729364352 00000100:00100000:3.0:1788839527.021691:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729364352 00000100:00100000:3.0:1788839527.021744:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1788839527.021755:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14428:x1875733729364352:12345-192.168.201.9@tcp:700:lfs.0 00000100:00100000:3.0:1788839527.021843:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14428:x1875733729364352:12345-192.168.201.9@tcp:700:lfs.0 Request processed in 90us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.021851:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:2.0:1788839527.026029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839527.026261:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729364608 00000100:00100000:1.0:1788839527.026271:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729364608 00000100:00100000:1.0:1788839527.026318:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1788839527.026328:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14428:x1875733729364608:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:1.0:1788839527.026393:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839527.026420:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d6364105f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb358 expref: 9 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.026439:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:1.0:1788839527.026445:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839527.026655:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.026668:0:14659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 5 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.026676:0:14659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.026706:0:14659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 5 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.026717:0:14659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 5 pid: 14371 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839527.026741:0:14659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747184256:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839527.026830:0:14659:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb059146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.031935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839527.032144:0:14659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb3357e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747184256:192.168.201.9@tcp:104: 00010000:00010000:1.0:1788839527.032171:0:14659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.032518:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729364736 00000100:00100000:2.0:1788839527.032526:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729364736 00010000:00010000:2.0:1788839527.032595:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 6 pid: 14371 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.032624:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1788839527.032635:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:2358:x1875733729364736:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839527.032650:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839527.032667:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 6 pid: 14371 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032680:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 6 pid: 14371 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032702:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f200/0x4b63896d63641097 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3ba expref: 6 pid: 14371 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032719:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:2.0:1788839527.032723:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032732:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032739:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032762:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839527.032810:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2358:x1875733729364736:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 177us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.032817:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00010000:00010000:2.0:1788839527.032937:0:14659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032957:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032979:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032989:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.032997:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839527.034142:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788839527.034156:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.034166:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.034173:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.034179:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9cc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839527.034183:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.034191:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.034204:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb0a302b00) 00010000:00010000:2.0:1788839527.034212:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839527.034217:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.034224:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d63641131 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839527.034243:0:14659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098cf5ec3 reply state 000000005cc56261 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.034252:0:14659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839527.034330:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+10:14428:x1875733729364608:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 8001us (8308us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788839527.034339:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00080000:3.0:1788839527.035394:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839527.045422:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.045441:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.045450:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.045457:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965c00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839527.045463:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.045471:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.045489:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eb0a302600) 00010000:00010000:3.0:1788839527.045492:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839527.045497:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.045503:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965c00/0x4b63896d63641138 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.168840:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839527.207176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839527.207747:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729364864 00000100:00100000:3.0:1788839527.207757:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729364864 00000100:00100000:3.0:1788839527.207862:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:3.0:1788839527.207873:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+9:14436:x1875733729364864:12345-192.168.201.9@tcp:101:lctl.0 00010000:00010000:3.0:1788839527.207898:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839527.207921:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364113f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.208016:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641146 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.208031:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.208043:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839527.208111:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788839527.208115:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839527.208151:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.208176:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364113f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3e4 expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.208195:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f600/0x4b63896d63641146 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3e4 expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.208203:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:3.0:1788839527.208206:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839527.208209:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f600, rc 0) 00000100:00100000:3.0:1788839527.208273:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+10:14436:x1875733729364864:12345-192.168.201.9@tcp:101:lctl.0 Request processed in 402us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.208280:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1788839527.266311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839527.266474:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729364992 00000100:00100000:2.0:1788839527.266494:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729364992 00000100:00100000:2.0:1788839527.266554:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:2.0:1788839527.266564:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:14437:x1875733729364992:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839527.266583:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839527.266605:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964200/0x4b63896d6364114d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3eb expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.266687:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965400/0x4b63896d63641154 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.266702:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965400/0x4b63896d63641154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.266712:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965400/0x4b63896d63641154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839527.266759:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788839527.266763:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839527.266780:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965400/0x4b63896d63641154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.266802:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964200/0x4b63896d6364114d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3eb expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.266821:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965400/0x4b63896d63641154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3eb expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.266829:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:2.0:1788839527.266832:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839527.266835:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965400, rc 0) 00000100:00100000:2.0:1788839527.266896:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:14437:x1875733729364992:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 333us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.266903:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:2.0:1788839527.269839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839527.270335:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729365120 00000100:00100000:3.0:1788839527.270345:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729365120 00000100:00100000:3.0:1788839527.270418:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:3.0:1788839527.270429:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+6:14437:x1875733729365120:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839527.270449:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839527.270467:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364115b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3f2 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271306:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271325:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271336:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271351:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271359:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271366:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271503:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6fa00/0x4b63896d63641170 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271512:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6fa00/0x4b63896d63641170 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271519:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6fa00/0x4b63896d63641170 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839527.271574:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788839527.271578:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839527.271600:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6fa00/0x4b63896d63641170 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271612:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271619:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271624:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271630:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839527.271634:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271640:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271653:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:3.0:1788839527.271656:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839527.271661:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271667:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271679:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271696:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271702:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271706:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6f800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839527.271709:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271716:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271723:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eb20904100) 00010000:00010000:3.0:1788839527.271725:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839527.271728:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271733:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d63641169 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271768:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364115b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3f2 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271781:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6fa00/0x4b63896d63641170 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3f2 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.271787:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb20904400) 00010000:00010000:3.0:1788839527.271789:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839527.271797:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6fa00, rc 0) 00000100:00100000:3.0:1788839527.271863:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+7:14437:x1875733729365120:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1436us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.271872:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:2.0:1788839527.280887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.281258:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729365376 00000100:00100000:0.0:1788839527.281268:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729365376 00000100:00100000:0.0:1788839527.281386:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:0.0:1788839527.281398:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+7:14437:x1875733729365376:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839527.281419:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839527.281438:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb3f9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839527.281536:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788839527.281657:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641177 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3f9 expref: 9 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.281671:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:0.0:1788839527.281674:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839527.281679:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3f9 expref: 9 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.281693:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bee400, rc 0) 00000100:00100000:0.0:1788839527.281757:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+8:14437:x1875733729365376:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 361us (881us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788839527.281764:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:3.0:1788839527.287315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839527.297699:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729365632 00000100:00100000:1.0:1788839527.297714:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729365632 00000100:00100000:1.0:1788839527.297771:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:1.0:1788839527.297779:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b27e0999-0c92-4e01-8851-8f25a699b1ef+8:14437:x1875733729365632:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:1.0:1788839527.297824:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839527.297846:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6fa00/0x4b63896d63641170 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb3f2 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.297862:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb20904400) 00010000:00010000:1.0:1788839527.297871:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839527.297888:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.297898:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.297904:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839527.298137:0:14659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000784d2521 reply state 00000000e1c3ce8b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839527.302195:0:14659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788839527.302215:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788839527.302326:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b27e0999-0c92-4e01-8851-8f25a699b1ef+9:14437:x1875733729365632:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 4542us (15015us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788839527.302335:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:0.0:1788839527.305212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.305251:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729365888 00000100:00100000:0.0:1788839527.305260:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729365888 00000100:00100000:0.0:1788839527.305309:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1788839527.305319:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+9:14437:x1875733729365888:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1788839527.305549:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+10:14437:x1875733729365888:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 231us (346us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788839527.305557:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00010000:00010000:3.0:1788839527.305767:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.305779:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.305786:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.305792:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839527.305797:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.305804:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.305819:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb05a79000) 00010000:00010000:3.0:1788839527.305822:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788839527.305827:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.305834:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d63641185 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839527.314297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.314386:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729366144 00000100:00100000:0.0:1788839527.314395:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729366144 00000100:00100000:0.0:1788839527.314453:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:0.0:1788839527.314464:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+9:14437:x1875733729366144:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839527.314488:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839527.314508:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364118c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb400 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314579:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314593:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314605:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314622:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314629:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314636:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839527.314743:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788839527.314846:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314855:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314861:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314867:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01beec00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839527.314872:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314879:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314892:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:0.0:1788839527.314895:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839527.314900:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314906:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d63641193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314919:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314925:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314931:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314956:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839527.314959:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314965:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314975:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eb10996e00) 00010000:00010000:0.0:1788839527.314977:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839527.314979:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.314985:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d6364119a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.315021:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364118c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb400 expref: 11 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.315032:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:0.0:1788839527.315034:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839527.315038:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364118c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb400 expref: 11 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.315077:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef600, rc 0) 00000100:00100000:0.0:1788839527.315141:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+10:14437:x1875733729366144:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 680us (854us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788839527.315149:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:3.0:1788839527.320025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.320208:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729366272 00000100:00100000:0.0:1788839527.320229:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729366272 00000100:00100000:0.0:1788839527.320285:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:0.0:1788839527.320295:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+10:14437:x1875733729366272:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839527.320317:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839527.320340:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636411a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb407 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.320426:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.320440:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.320452:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839527.320474:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788839527.320477:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839527.320493:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.320519:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636411a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.320536:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.320544:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:0.0:1788839527.320547:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839527.320551:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef200, rc 0) 00000100:00100000:0.0:1788839527.320620:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+11:14437:x1875733729366272:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 326us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.320627:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:3.0:1788839527.328353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.328457:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729366400 00000100:00100000:0.0:1788839527.328470:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729366400 00000100:00100000:0.0:1788839527.328526:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:0.0:1788839527.328536:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+11:14437:x1875733729366400:12345-192.168.201.9@tcp:37:lfs.0 00000100:00100000:1.0:1788839527.335008:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b27e0999-0c92-4e01-8851-8f25a699b1ef+11:14437:x1875733729366400:12345-192.168.201.9@tcp:37:lfs.0 Request processed in 6459us (6650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.335022:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:1.0:1788839527.344286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839527.345269:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729366656 00000100:00100000:3.0:1788839527.345280:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729366656 00000100:00100000:3.0:1788839527.345342:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:3.0:1788839527.345353:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb36e88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+11:14437:x1875733729366656:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1788839527.345611:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb36e88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+12:14437:x1875733729366656:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 260us (1334us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788839527.345620:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:3.0:1788839527.452818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839527.452999:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729366784 00000100:00100000:1.0:1788839527.453009:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729366784 00000100:00100000:1.0:1788839527.453117:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:1.0:1788839527.453129:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+10:14443:x1875733729366784:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1788839527.453159:0:14659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839527.453179:0:14659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636411b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb40e expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453246:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453262:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453273:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453289:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453316:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453323:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453418:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d636411cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453427:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d636411cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453434:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d636411cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839527.453460:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788839527.453464:0:14659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839527.453499:0:14659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d636411cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453511:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453518:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453525:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453531:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839527.453536:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453549:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453562:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:1.0:1788839527.453565:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839527.453570:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453577:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636411bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453589:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453595:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453601:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453606:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839527.453609:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453616:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453623:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eb05a79b00) 00010000:00010000:1.0:1788839527.453626:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839527.453629:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453644:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636411c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453677:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636411b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb40e expref: 12 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453690:0:14659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d200/0x4b63896d636411cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb40e expref: 11 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.453697:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:1.0:1788839527.453699:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788839527.453702:0:14659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb09c9d200, rc 0) 00000100:00100000:1.0:1788839527.453775:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+11:14443:x1875733729366784:12345-192.168.201.9@tcp:101:bash.0 Request processed in 647us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.453782:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:2.0:1788839527.460896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.461171:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729367040 00000100:00100000:0.0:1788839527.461181:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729367040 00000100:00100000:0.0:1788839527.461288:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:0.0:1788839527.461300:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+11:14443:x1875733729367040:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839527.461322:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839527.461343:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636411d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb415 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.461470:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.461498:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.461508:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.461553:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.461568:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 11 pid: 14372 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839527.461595:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14372:1875733747184384:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839527.461713:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb330c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.465349:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14372:1875733747184384:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839527.465405:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.490537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839527.500336:0:16489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729367168 00000100:00100000:3.0:1788839527.500362:0:16489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729367168 00010000:00010000:3.0:1788839527.500411:0:16489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 12 pid: 14372 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839527.500558:0:16489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:3.0:1788839527.500573:0:16489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b27e0999-0c92-4e01-8851-8f25a699b1ef+12:2358:x1875733729367168:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839527.500591:0:16489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839527.500601:0:16489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 12 pid: 14372 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.500632:0:16489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 12 pid: 14372 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.500660:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636411af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb407 expref: 12 pid: 14372 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.500945:0:16489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:3.0:1788839527.500952:0:16489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.500977:0:16489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.500985:0:16489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.501024:0:16489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839527.501148:0:16489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b27e0999-0c92-4e01-8851-8f25a699b1ef+11:2358:x1875733729367168:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 580us (10629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.501157:0:16489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00010000:00010000:0.0:1788839527.502324:0:14372:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.502337:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.502376:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.502388:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.502398:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.503334:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.503345:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.503913:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839527.503949:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788839527.503980:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.503989:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.503997:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.504004:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839527.504008:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.504017:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.504030:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:0.0:1788839527.504032:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839527.504037:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.504042:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636411d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839527.504618:0:14372:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df28981c reply state 00000000fb4ffb82 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839527.504628:0:14372:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788839527.504784:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d636411d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 14 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.504820:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.504827:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839527.504830:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788839527.504833:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01beec00, rc 0) 00000100:00100000:0.0:1788839527.504913:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+14:14443:x1875733729367040:12345-192.168.201.9@tcp:101:bash.0 Request processed in 43615us (44026us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788839527.504923:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00010000:00010000:3.0:1788839527.518496:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.518516:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.518524:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.518531:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee200 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839527.518536:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.518544:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.518564:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91eb10996e00) 00010000:00010000:3.0:1788839527.518567:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839527.518572:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.518598:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d636411e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839527.542916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839527.543165:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729367296 00000100:00100000:2.0:1788839527.543176:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729367296 00000100:00100000:2.0:1788839527.543242:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:2.0:1788839527.543253:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+13:14443:x1875733729367296:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1788839527.543275:0:14659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839527.543297:0:14659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d636411f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb41c expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.543392:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d636411fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.543405:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d636411fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.543418:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d636411fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839527.543453:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788839527.543457:0:14659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788839527.543477:0:14659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d636411fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.543488:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d636411fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.543511:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d636411f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb41c expref: 15 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.543543:0:14659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d636411fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb41c expref: 14 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.543552:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:2.0:1788839527.543555:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839527.543559:0:14659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964600, rc 0) 00000100:00100000:2.0:1788839527.543622:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+14:14443:x1875733729367296:12345-192.168.201.9@tcp:101:bash.0 Request processed in 370us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.543630:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:2.0:1788839527.561333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839527.561727:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729367552 00000100:00100000:3.0:1788839527.561738:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729367552 00000100:00100000:3.0:1788839527.561801:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:3.0:1788839527.561812:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+14:14443:x1875733729367552:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:3.0:1788839527.562444:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+15:14443:x1875733729367552:12345-192.168.201.9@tcp:35:bash.0 Request processed in 632us (1121us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788839527.562453:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000040:00080000:0.0:1788839527.614366:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788839527.746354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.746455:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729367808 00000100:00100000:0.0:1788839527.746465:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729367808 00000100:00100000:0.0:1788839527.746530:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:0.0:1788839527.746540:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+15:14453:x1875733729367808:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1788839527.746560:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839527.746578:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb423 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839527.746662:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788839527.746775:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641203 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb423 expref: 17 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.746789:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:0.0:1788839527.746792:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839527.746797:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb423 expref: 17 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.746829:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bee400, rc 0) 00000100:00100000:0.0:1788839527.746903:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+16:14453:x1875733729367808:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 351us (546us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788839527.746911:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1788839527.759154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839527.759290:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729368064 00000100:00100000:2.0:1788839527.759300:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729368064 00000100:00100000:2.0:1788839527.759363:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1788839527.759374:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+16:14453:x1875733729368064:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839527.759653:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+17:14453:x1875733729368064:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 280us (509us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788839527.759661:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1788839527.806166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839527.806269:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729368320 00000100:00100000:2.0:1788839527.806279:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729368320 00000100:00100000:2.0:1788839527.806340:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:2.0:1788839527.806352:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+17:14456:x1875733729368320:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839527.806379:0:14659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839527.806400:0:14659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d63641211 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb42a expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.806495:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641218 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.806508:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.806532:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839527.806544:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788839527.806664:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d63641211 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb42a expref: 20 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.806703:0:14659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb42a expref: 19 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.806712:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:2.0:1788839527.806716:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839527.806720:0:14659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964e00, rc 0) 00000100:00100000:2.0:1788839527.806785:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+19:14456:x1875733729368320:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 435us (628us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788839527.806793:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:3.0:1788839527.812145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839527.812291:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729368448 00000100:00100000:0.0:1788839527.812302:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729368448 00000100:00100000:0.0:1788839527.812358:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:0.0:1788839527.812369:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+19:14456:x1875733729368448:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1788839527.812438:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812456:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812468:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812494:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812500:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812507:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812512:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839527.812516:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812551:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812564:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839527.812567:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839527.812571:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.812577:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641226 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839527.812649:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+19:14456:x1875733729368448:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 281us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.812657:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:1.0:1788839527.820193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839527.820344:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729368576 00000100:00100000:2.0:1788839527.820354:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729368576 00000100:00100000:2.0:1788839527.820422:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:2.0:1788839527.820433:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+19:2358:x1875733729368576:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839527.820449:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839527.820474:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641218 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb42a expref: 19 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.820495:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:2.0:1788839527.820501:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839527.820574:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+18:2358:x1875733729368576:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 143us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.820581:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1788839527.822985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839527.823506:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729368832 00000100:00100000:2.0:1788839527.823529:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729368832 00000100:00100000:2.0:1788839527.823590:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1788839527.823614:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+18:14456:x1875733729368832:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839527.824070:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+19:14456:x1875733729368832:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 440us (1075us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788839527.824078:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00010000:00010000:2.0:1788839528.189274:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839528.244084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839528.244542:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729369088 00000100:00100000:2.0:1788839528.244553:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729369088 00000100:00100000:2.0:1788839528.244626:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:2.0:1788839528.244637:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+19:14487:x1875733729369088:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:2.0:1788839528.244672:0:14659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839528.244693:0:14659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d6364122d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb431 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839528.244797:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d63641234 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839528.244814:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d63641234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839528.244825:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d63641234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839528.244838:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788839528.245002:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d6364122d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb431 expref: 22 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839528.245022:0:14659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d63641234 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb431 expref: 21 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839528.245092:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:2.0:1788839528.245095:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839528.245100:0:14659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20965800, rc 0) 00000100:00100000:2.0:1788839528.245156:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+21:14487:x1875733729369088:12345-192.168.201.9@tcp:101:cat.0 Request processed in 521us (1106us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788839528.245164:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00080000:3.0:1788839528.245719:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839528.251628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839528.251895:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729369344 00000100:00100000:3.0:1788839528.251906:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729369344 00000100:00100000:1.0:1788839528.252653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839528.254120:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1788839528.254142:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+21:14487:x1875733729369344:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:3.0:1788839528.254512:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+22:14487:x1875733729369344:12345-192.168.201.9@tcp:35:cat.0 Request processed in 377us (2893us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788839528.254520:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:2.0:1788839528.254606:0:16489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729369472 00000100:00100000:2.0:1788839528.254614:0:16489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729369472 00000100:00100000:2.0:1788839528.254656:0:16489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:2.0:1788839528.254664:0:16489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+22:2357:x1875733729369472:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839528.254674:0:16489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839528.254698:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d63641234 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb431 expref: 22 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839528.254716:0:16489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:2.0:1788839528.254722:0:16489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839528.254756:0:16489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+21:2357:x1875733729369472:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 93us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839528.254764:0:16489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:3.0:1788839528.376165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839528.378094:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729369728 00000100:00100000:0.0:1788839528.378109:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729369728 00000100:00100000:0.0:1788839528.378181:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:0.0:1788839528.378194:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+21:14493:x1875733729369728:12345-192.168.201.9@tcp:101:dd.0 00010000:00010000:0.0:1788839528.378219:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839528.378241:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641242 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb438 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.378347:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641249 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.378367:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.378380:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839528.378406:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788839528.378567:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d63641242 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb438 expref: 24 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.378586:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641249 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb438 expref: 23 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.378595:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839528.378598:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839528.378602:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef600, rc 0) 00000100:00100000:0.0:1788839528.378682:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+23:14493:x1875733729369728:12345-192.168.201.9@tcp:101:dd.0 Request processed in 491us (2529us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788839528.378690:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:1.0:1788839528.384009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839528.384111:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729369984 00000100:00100000:3.0:1788839528.384128:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729369984 00000100:00100000:3.0:1788839528.384235:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:3.0:1788839528.384248:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+23:14493:x1875733729369984:12345-192.168.201.9@tcp:36:dd.0 00010000:00010000:3.0:1788839528.384330:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788839528.384368:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641249 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb438 expref: 23 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.384400:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d636411fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb41c expref: 22 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.384415:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:3.0:1788839528.384421:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839528.384770:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.384788:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.384800:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839528.384857:0:14659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788839528.385757:0:14659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089f89fe3 reply state 00000000fc2bd899 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839528.385780:0:14659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839528.386623:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+24:14493:x1875733729369984:12345-192.168.201.9@tcp:36:dd.0 Request processed in 2367us (2613us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788839528.386637:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000020:00080000:3.0:1788839528.386647:0:14659:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788839528.392366:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.392401:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.392409:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.392415:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839528.392420:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.392429:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.392448:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:3.0:1788839528.392451:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839528.392457:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.392463:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d63641257 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839528.518385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839528.518533:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729370240 00000100:00100000:0.0:1788839528.518546:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729370240 00000100:00100000:0.0:1788839528.518627:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:0.0:1788839528.518639:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+23:14493:x1875733729370240:12345-192.168.201.9@tcp:35:dd.0 00000100:00100000:0.0:1788839528.518986:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+24:14493:x1875733729370240:12345-192.168.201.9@tcp:35:dd.0 Request processed in 348us (617us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1788839528.518995:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:1.0:1788839528.748409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839528.748528:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729370368 00000100:00100000:0.0:1788839528.748540:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729370368 00000100:00100000:0.0:1788839528.748609:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:0.0:1788839528.748619:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+24:14507:x1875733729370368:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:0.0:1788839528.748648:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839528.748691:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364125e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb43f expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748771:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748788:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748798:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748811:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748816:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748820:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748933:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641273 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748941:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.748948:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839528.748993:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788839528.748996:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839528.749034:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749084:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749092:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749097:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749102:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749106:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839528.749110:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749116:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749126:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:0.0:1788839528.749128:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839528.749132:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749136:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d63641265 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749154:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749160:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749172:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749178:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839528.749181:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749187:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749195:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91eb10996900) 00010000:00010000:0.0:1788839528.749198:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839528.749200:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749207:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d6364126c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749246:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364125e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb43f expref: 26 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749262:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641273 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb43f expref: 25 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.749269:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839528.749272:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839528.749275:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef800, rc 0) 00000100:00100000:0.0:1788839528.749355:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+25:14507:x1875733729370368:12345-192.168.201.9@tcp:101:stat.0 Request processed in 736us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839528.749369:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:2.0:1788839528.765660:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747184512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839528.765762:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839528.768295:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747184512 00000100:00100000:3.0:1788839528.768316:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747184512 00000100:00100000:3.0:1788839528.768433:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839528.768448:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747184512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788839528.768658:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788839528.769259:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788839528.769414:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747184512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 965us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839528.769424:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839528.769910:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747184512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839528.826586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839528.829010:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729370624 00000100:00100000:0.0:1788839528.829033:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729370624 00000100:00100000:0.0:1788839528.829197:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:0.0:1788839528.829210:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+25:14513:x1875733729370624:12345-192.168.201.9@tcp:36:truncate.0 00010000:00010000:0.0:1788839528.829288:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839528.829324:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641273 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb43f expref: 25 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.829349:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839528.829356:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839528.829908:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.829937:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839528.829950:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839528.830015:0:14373:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1788839528.830044:0:14373:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f85309e reply state 000000005416978a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839528.830109:0:14373:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839528.831707:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+27:14513:x1875733729370624:12345-192.168.201.9@tcp:36:truncate.0 Request processed in 2485us (5123us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788839528.831720:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00000020:00080000:0.0:1788839528.831729:0:14373:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788839528.840266:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.840292:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.840300:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.840307:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee400 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839528.840314:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.840323:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.840353:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:3.0:1788839528.840357:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839528.840364:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839528.840370:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee400/0x4b63896d6364127a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839529.044382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.044579:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729370752 00000100:00100000:0.0:1788839529.044593:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729370752 00000100:00100000:0.0:1788839529.044679:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:0.0:1788839529.044693:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+26:14527:x1875733729370752:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:0.0:1788839529.044726:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.044758:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641281 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb446 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.044850:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.044870:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.044883:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.044900:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.044923:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.044930:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045046:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045114:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045158:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839529.045203:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788839529.045208:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839529.045232:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045246:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045256:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045263:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045270:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045277:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839529.045282:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045291:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045306:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:0.0:1788839529.045310:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839529.045315:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045333:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d63641288 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045351:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045357:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045363:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045369:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bee800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839529.045372:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045378:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045386:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91eb10996900) 00010000:00010000:0.0:1788839529.045388:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839529.045391:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045397:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d6364128f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045434:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641281 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 28 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045461:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 27 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.045469:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839529.045472:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839529.045475:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bee200, rc 0) 00000100:00100000:0.0:1788839529.045562:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+27:14527:x1875733729370752:12345-192.168.201.9@tcp:101:stat.0 Request processed in 872us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.045571:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1788839529.138528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.138694:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729371008 00000100:00100000:3.0:1788839529.138711:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729371008 00000100:00100000:3.0:1788839529.138803:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:3.0:1788839529.138818:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+27:14537:x1875733729371008:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1788839529.138852:0:14659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839529.138886:0:14659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364129d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb44d expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839529.139322:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788839529.139657:0:14659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364129d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb44d expref: 29 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.139676:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:3.0:1788839529.139680:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839529.139686:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d6364129d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb44d expref: 29 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.139708:0:14659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6e600, rc 0) 00000100:00100000:3.0:1788839529.139807:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+28:14537:x1875733729371008:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 991us (1295us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788839529.139817:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1788839529.144349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.144448:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729371264 00000100:00100000:0.0:1788839529.144460:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729371264 00000100:00100000:0.0:1788839529.144623:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1788839529.144636:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb09e69850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+28:14537:x1875733729371264:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1788839529.144957:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb09e69850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+29:14537:x1875733729371264:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 323us (619us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788839529.144967:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00010000:00010000:0.0:1788839529.213932:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839529.268186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.268547:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729371520 00000100:00100000:0.0:1788839529.268559:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729371520 00000100:00100000:0.0:1788839529.268628:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:0.0:1788839529.268638:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+29:14543:x1875733729371520:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839529.268666:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.268691:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d636412ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb454 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.268840:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.268853:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 30 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.268859:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 30 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.268865:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.268925:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 30 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.268942:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 30 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.268957:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14371:1875733747184640:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839529.269118:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 30 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.269128:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 30 pid: 14372 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.269138:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37577480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14371:1875733747184768:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839529.269175:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb14764c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839529.271210:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14371:1875733747184640:192.168.201.9@tcp:104: 00000100:00100000:1.0:1788839529.273457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.273497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.273592:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729371776 00000100:00100000:2.0:1788839529.273620:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729371776 00010000:00010000:2.0:1788839529.273669:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 31 pid: 14372 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839529.273714:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729371648 00000100:00100000:2.0:1788839529.273717:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729371648 00010000:00010000:2.0:1788839529.273729:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 32 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839529.273753:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839529.273764:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb1027a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+32:2358:x1875733729371776:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839529.273783:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839529.273791:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 32 pid: 14372 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.273804:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 32 pid: 14372 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.273830:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:2.0:1788839529.273836:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.273845:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.273851:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839529.273928:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb1027a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+32:2358:x1875733729371776:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 165us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.273935:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1788839529.274010:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1788839529.274018:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+31:2358:x1875733729371648:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839529.274026:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839529.274032:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 31 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.274043:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 31 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.274091:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee200/0x4b63896d63641296 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb446 expref: 31 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.274109:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:2.0:1788839529.274112:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.274121:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.274129:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.274151:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839529.274171:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+30:2358:x1875733729371648:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 153us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.274178:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00010000:00010000:0.0:1788839529.274379:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d636411e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb415 expref: 29 pid: 14372 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.274392:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37577480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14371:1875733747184768:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839529.274430:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.274440:0:14371:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.274446:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839529.274469:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788839529.274656:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d636412ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 30 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.274671:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 29 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.274679:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839529.274681:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839529.274684:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bee800, rc 0) 00000100:00100000:0.0:1788839529.274727:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+29:14543:x1875733729371520:12345-192.168.201.9@tcp:101:bash.0 Request processed in 6091us (6559us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788839529.274734:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:1.0:1788839529.278378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.278610:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729372032 00000100:00100000:0.0:1788839529.278624:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729372032 00000100:00100000:0.0:1788839529.278701:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:0.0:1788839529.278714:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+29:14543:x1875733729372032:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:0.0:1788839529.279697:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.279728:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.279742:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839529.279799:0:14373:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1788839529.279825:0:14373:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcfbf9da reply state 00000000b65aee8b transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.279834:0:14373:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839529.279955:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14543:x1875733729372032:12345-192.168.201.9@tcp:36:bash.0 Request processed in 1240us (1588us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1788839529.279966:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00000020:00080000:0.0:1788839529.279974:0:14373:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788839529.282505:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.282532:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.282542:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.282548:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839529.282555:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.282565:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.282613:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:3.0:1788839529.282616:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839529.282622:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.282629:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef600/0x4b63896d636412c0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839529.283348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.283425:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729372160 00000100:00100000:0.0:1788839529.283441:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729372160 00000100:00100000:0.0:1788839529.283517:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:0.0:1788839529.283531:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+31:14543:x1875733729372160:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839529.283558:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.283578:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636412c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb45b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.283656:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636412c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb45b expref: 32 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.283670:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636412c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb45b expref: 32 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.283691:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839529.283694:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839529.283698:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef200, rc 0) 00000100:00100000:0.0:1788839529.283784:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14543:x1875733729372160:12345-192.168.201.9@tcp:101:bash.0 Request processed in 257us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.283792:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:2.0:1788839529.291168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.291242:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729372288 00000100:00100000:3.0:1788839529.291253:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729372288 00000100:00100000:3.0:1788839529.291313:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:3.0:1788839529.291321:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14543:x1875733729372288:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1788839529.291345:0:14659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839529.291371:0:14659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb462 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.291471:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.291483:0:14659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 33 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.291499:0:14659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.291542:0:14659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 33 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.291554:0:14659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 33 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839529.291582:0:14659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb03109c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747184896:192.168.201.9@tcp:104: 00000100:00100000:3.0:1788839529.291685:0:14659:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb032f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839529.296301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.296396:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729372416 00000100:00100000:0.0:1788839529.296411:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729372416 00010000:00010000:0.0:1788839529.296456:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 34 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839529.296497:0:14659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb03109c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747184896:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839529.296499:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:0.0:1788839529.296517:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+34:2358:x1875733729372416:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839529.296534:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839529.296542:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 34 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.296546:0:14659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.296565:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 34 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.299677:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb454 expref: 34 pid: 14371 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.299706:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:0.0:1788839529.299712:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.299721:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.299737:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.299773:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839529.299839:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+33:2358:x1875733729372416:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 3327us (3554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.299848:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00010000:00010000:3.0:1788839529.300106:0:14659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.300123:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839529.300707:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788839529.300715:0:14659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788839529.300749:0:14659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.300799:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb462 expref: 33 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.300824:0:14659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb462 expref: 32 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.300840:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:3.0:1788839529.300843:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839529.300847:0:14659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f800, rc 0) 00000100:00100000:3.0:1788839529.301303:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14543:x1875733729372288:12345-192.168.201.9@tcp:101:bash.0 Request processed in 9978us (10142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839529.301331:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:2.0:1788839529.305919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.306331:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729372672 00000100:00100000:3.0:1788839529.306345:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729372672 00000100:00100000:3.0:1788839529.306429:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:3.0:1788839529.306441:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14543:x1875733729372672:12345-192.168.201.9@tcp:103:bash.0 00010000:00010000:3.0:1788839529.306462:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788839529.306568:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb462 expref: 32 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.306600:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef200/0x4b63896d636412c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb45b expref: 31 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.306613:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb10996800) 00010000:00010000:3.0:1788839529.306626:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839529.306697:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+30:14543:x1875733729372672:12345-192.168.201.9@tcp:103:bash.0 Request processed in 258us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839529.306706:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:1.0:1788839529.311099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.313025:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729372800 00000100:00100000:3.0:1788839529.313081:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729372800 00000100:00100000:3.0:1788839529.313190:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:3.0:1788839529.313204:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+30:14543:x1875733729372800:12345-192.168.201.9@tcp:58:bash.0 00010000:00010000:3.0:1788839529.313399:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.313420:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.313453:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839529.316718:0:14371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839529.317700:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788839529.317884:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788839529.318518:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb3357d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+30:14543:x1875733729372800:12345-192.168.201.9@tcp:58:bash.0 Request processed in 5302us (7469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.318534:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:2.0:1788839529.322791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.323037:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729372928 00000100:00100000:0.0:1788839529.323095:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729372928 00000100:00100000:0.0:1788839529.323200:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:0.0:1788839529.323213:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+30:14543:x1875733729372928:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839529.323241:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.323271:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb469 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.323351:0:14373:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.323391:0:14373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb469 expref: 31 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.323415:0:14373:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.323431:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb469 expref: 31 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.323448:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb20904100) 00010000:00010000:0.0:1788839529.323452:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839529.323457:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb469 expref: 31 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.323465:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bee800, rc 0) 00000100:00100000:0.0:1788839529.323801:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+31:14543:x1875733729372928:12345-192.168.201.9@tcp:101:bash.0 Request processed in 589us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.323810:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1788839529.531543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.531615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.531650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.531694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.531695:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373312 00000100:00100000:2.0:1788839529.531710:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373312 00000100:00100000:1.0:1788839529.531724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.531784:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373568 00000100:00100000:2.0:1788839529.531788:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373568 00000100:00100000:2.0:1788839529.531802:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373184 00000100:00100000:2.0:1788839529.531804:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373184 00000100:00100000:2.0:1788839529.531823:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1788839529.531835:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2358:x1875733729373312:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839529.531943:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2358:x1875733729373312:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 110us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.531953:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1788839529.531974:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:2.0:1788839529.531981:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2358:x1875733729373568:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839529.532007:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2358:x1875733729373568:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.532014:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:2.0:1788839529.532025:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:1.0:1788839529.532033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.532039:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2358:x1875733729373184:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839529.532103:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2358:x1875733729373184:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 71us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.532142:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:2.0:1788839529.532156:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373696 00000100:00100000:2.0:1788839529.532160:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373696 00000100:00100000:2.0:1788839529.532192:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:2.0:1788839529.532199:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2358:x1875733729373696:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1788839529.532228:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b27e0999-0c92-4e01-8851-8f25a699b1ef+5:2358:x1875733729373696:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 30us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.532235:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00080000:2.0:1788839529.532256:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839529.532262:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839529.532269:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373056 00000100:00100000:3.0:1788839529.532275:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373056 00000100:00100000:3.0:1788839529.532319:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:3.0:1788839529.532328:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:2358:x1875733729373056:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1788839529.532460:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373440 00000100:00100000:0.0:1788839529.532466:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373440 00000100:00100000:0.0:1788839529.532752:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:0.0:1788839529.532761:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+11:2358:x1875733729373440:12345-192.168.201.9@tcp:400:kworker.0 00000100:00080000:1.0:1788839529.534332:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839529.535583:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd4e02a7-c776-47a2-b6e8-14e112fedfa2+13:2358:x1875733729373056:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 3228us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839529.535602:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:0.0:1788839529.543195:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b27e0999-0c92-4e01-8851-8f25a699b1ef+11:2358:x1875733729373440:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 10411us (11446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.543217:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000040:00080000:0.0:1788839529.661553:0:14406:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788839529.661599:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839529.661655:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788839529.661663:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788839529.661915:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37577480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14406:1875733747185024:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839529.662095:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0c652d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839529.671879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.672569:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373824 00000100:00100000:3.0:1788839529.672587:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373824 00000100:00100000:3.0:1788839529.672658:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1788839529.672671:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14544:x1875733729373824:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788839529.672806:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14544:x1875733729373824:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 Request processed in 137us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839529.672815:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:0.0:1788839529.674535:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37577480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14406:1875733747185024:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788839529.687316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.687460:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729373952 00000100:00100000:0.0:1788839529.687475:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729373952 00000100:00100000:0.0:1788839529.687571:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:0.0:1788839529.687786:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+31:14544:x1875733729373952:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788839529.687835:0:14373:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788839529.688101:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+31:14544:x1875733729373952:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 519us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.688111:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:2.0:1788839529.706582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.706737:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729374080 00000100:00100000:1.0:1788839529.706751:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729374080 00000100:00100000:1.0:1788839529.706821:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:1.0:1788839529.706834:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+31:14544:x1875733729374080:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788839529.706948:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.706973:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.706988:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707281:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707326:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707339:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707382:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707391:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707398:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839529.707443:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788839529.707446:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788839529.707463:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707475:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707481:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707489:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707495:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9cc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839529.707498:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707511:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707523:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb20904d00) 00010000:00010000:1.0:1788839529.707526:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839529.707531:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707538:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636412ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707552:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707558:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707564:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707579:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839529.707582:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707588:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707594:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91eb05a79b00) 00010000:00010000:1.0:1788839529.707596:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839529.707599:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707613:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636412f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707635:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707640:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707646:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707651:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9ce00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839529.707654:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707660:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707667:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb20904100) 00010000:00010000:1.0:1788839529.707671:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839529.707674:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.707679:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9ce00/0x4b63896d636412f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839529.707767:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+31:14544:x1875733729374080:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 932us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839529.707777:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:1.0:1788839529.714488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.714644:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729374336 00000100:00100000:3.0:1788839529.714662:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729374336 00000100:00100000:3.0:1788839529.714746:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:3.0:1788839529.714759:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+31:14544:x1875733729374336:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839529.714787:0:14659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839529.714817:0:14659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb470 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.715009:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.715036:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.715087:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839529.715104:0:14659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788839529.715260:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.715269:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.718137:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.718160:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839529.718167:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.718179:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.718203:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb20904100) 00010000:00010000:3.0:1788839529.718206:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839529.718212:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.718249:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e000/0x4b63896d63641306 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.719755:0:14659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412ff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb470 expref: 33 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.719779:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eb20904d00) 00010000:00010000:3.0:1788839529.719782:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839529.719788:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6f800/0x4b63896d636412ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb470 expref: 33 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.719807:0:14659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20a6f800, rc 0) 00000100:00100000:3.0:1788839529.719943:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14544:x1875733729374336:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 5185us (5464us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788839529.719956:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:2.0:1788839529.732268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.732410:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729374464 00000100:00100000:1.0:1788839529.732420:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729374464 00000100:00100000:1.0:1788839529.732543:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:1.0:1788839529.732555:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14544:x1875733729374464:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839529.732603:0:14371:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839529.732774:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14544:x1875733729374464:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 221us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839529.732783:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:2.0:1788839529.749536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.749690:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729374720 00000100:00100000:0.0:1788839529.749701:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729374720 00000100:00100000:0.0:1788839529.749763:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:0.0:1788839529.749773:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+32:14544:x1875733729374720:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.749794:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.749828:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641314 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb477 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839529.753113:0:14373:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788839529.753126:0:14373:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788839529.753230:0:14373:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788839529.753588:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364131b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.753613:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364131b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.753626:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364131b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.753697:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641314 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb477 expref: 35 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.753716:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364131b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb477 expref: 34 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.753724:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996900) 00010000:00010000:0.0:1788839529.753727:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839529.753730:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01beec00, rc 0) 00000100:00100000:0.0:1788839529.756758:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+34:14544:x1875733729374720:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 6974us (7220us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788839529.756771:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1788839529.768099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.768267:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729374976 00000100:00100000:0.0:1788839529.768277:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729374976 00000100:00100000:0.0:1788839529.768344:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:0.0:1788839529.768354:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+34:14544:x1875733729374976:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.768418:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839529.768452:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364131b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb477 expref: 34 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768472:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996900) 00010000:00010000:0.0:1788839529.768501:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839529.768528:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768542:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768552:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768565:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768570:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768575:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768638:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768645:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768652:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768657:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839529.768662:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768670:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768688:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:0.0:1788839529.768690:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839529.768695:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768701:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d63641329 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768711:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768717:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768723:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768728:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01befe00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:0.0:1788839529.768731:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768737:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768744:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x24f6a6e1 (ffff91eb10996500) 00010000:00010000:0.0:1788839529.768747:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839529.768750:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.768755:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641330 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x24f6a6e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.768998:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+33:14544:x1875733729374976:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 645us (954us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839529.769006:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1788839529.778931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.779026:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729375104 00000100:00100000:3.0:1788839529.779035:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729375104 00000100:00100000:0.0:1788839529.779147:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:0.0:1788839529.779160:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+33:14544:x1875733729375104:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.779195:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.779220:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641337 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb47e expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.779257:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d6364133e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.779271:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d6364133e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.779281:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d6364133e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.779383:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d63641337 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb47e expref: 35 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.779402:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bef800/0x4b63896d6364133e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb47e expref: 34 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.779410:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:0.0:1788839529.779412:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788839529.779415:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef800, rc 0) 00000100:00100000:0.0:1788839529.779492:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+34:14544:x1875733729375104:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 336us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.779499:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:2.0:1788839529.788133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.788389:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729375360 00000100:00100000:1.0:1788839529.788399:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729375360 00000100:00100000:1.0:1788839529.788462:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1788839529.788473:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+34:14544:x1875733729375360:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788839529.788615:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.788698:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.788710:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839529.789134:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788839529.789145:0:14371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 512480094182ns, next at 513480091887ns, rc = 0 00000004:00010000:1.0:1788839529.789229:0:14371:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc4f9e66 reply state 00000000da2ca0b7 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839529.789239:0:14371:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839529.790226:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+36:14544:x1875733729375360:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1750us (2099us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788839529.790257:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00010000:00010000:3.0:1788839529.804882:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.804905:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.804911:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.804915:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:3.0:1788839529.804919:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.804937:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.804951:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:3.0:1788839529.804953:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788839529.804956:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.804960:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d63641345 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839529.806996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.807224:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729375488 00000100:00100000:0.0:1788839529.807234:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729375488 00000100:00100000:0.0:1788839529.807296:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:0.0:1788839529.807307:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+35:14544:x1875733729375488:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.807330:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.807350:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb485 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.807408:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 36 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.807421:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 36 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.807440:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:0.0:1788839529.807443:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839529.807446:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01befe00, rc 0) 00000100:00100000:0.0:1788839529.807512:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+36:14544:x1875733729375488:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 206us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.807518:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:1.0:1788839529.809556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.809614:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729375616 00000100:00100000:2.0:1788839529.809621:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729375616 00000100:00100000:2.0:1788839529.809671:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1788839529.809682:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+5:2357:x1875733729375616:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788839529.810083:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2357:x1875733729375616:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 402us (531us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788839529.810091:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1788839529.817649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.817849:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729375872 00000100:00100000:0.0:1788839529.817859:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729375872 00000100:00100000:0.0:1788839529.817947:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1788839529.817956:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+36:14544:x1875733729375872:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788839529.818236:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+37:14544:x1875733729375872:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 280us (596us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788839529.818242:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1788839529.820915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.821006:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729376128 00000100:00100000:2.0:1788839529.821028:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729376128 00000100:00100000:2.0:1788839529.821278:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:2.0:1788839529.821289:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+37:14544:x1875733729376128:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788839529.821404:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+37:14544:x1875733729376128:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 117us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.821412:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:1.0:1788839529.828788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.828894:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729376256 00000100:00100000:0.0:1788839529.828912:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729376256 00000100:00100000:0.0:1788839529.828983:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:0.0:1788839529.828994:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+37:14544:x1875733729376256:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.829019:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.829042:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641353 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb48c expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.829467:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364135a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.829488:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364135a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.829500:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364135a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839529.829541:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788839529.829557:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364135a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.829578:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641353 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb48c expref: 39 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.829591:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364135a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb48c expref: 38 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.829603:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:0.0:1788839529.829605:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788839529.829607:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01beec00, rc 0) 00000100:00100000:0.0:1788839529.829706:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+38:14544:x1875733729376256:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 714us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.829712:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:3.0:1788839529.833141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.833682:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729376384 00000100:00100000:0.0:1788839529.833693:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729376384 00000100:00100000:0.0:1788839529.833757:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1788839529.833770:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2357:x1875733729376384:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.833791:0:15055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.833815:0:15055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb493 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839529.833843:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f866a, blocks: 0x1 00010000:00010000:0.0:1788839529.833863:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1788839529.833868:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839529.833877:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 7 pid: 15055 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.833909:0:15055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 7 pid: 15055 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.833924:0:15055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef200, rc 0) 00000100:00100000:0.0:1788839529.834005:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+7:2357:x1875733729376384:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 237us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.834012:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1788839529.840606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.840703:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729376640 00000100:00100000:0.0:1788839529.840713:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729376640 00000100:00100000:0.0:1788839529.840820:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:0.0:1788839529.840831:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+38:14544:x1875733729376640:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788839529.840970:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+38:14544:x1875733729376640:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 140us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.840978:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:3.0:1788839529.843285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839529.844178:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729376768 00000100:00100000:1.0:1788839529.844188:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729376768 00000100:00100000:1.0:1788839529.844247:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:1.0:1788839529.844372:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+38:14544:x1875733729376768:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788839529.930007:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:0.0:1788839529.930065:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:0.0:1788839529.930456:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788839529.930673:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839529.930693:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb107eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747185152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788839529.930765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839529.930837:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747185152 00000100:00100000:2.0:1788839529.930845:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747185152 00000100:00100000:2.0:1788839529.930908:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839529.930919:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747185152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788839529.931086:0:15058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788839529.931090:0:15058:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788839529.931093:0:15058:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788839529.931095:0:15058:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788839530 -> 1788839530 00002000:00010000:2.0:1788839529.931097:0:15058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788839529.931133:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb107eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875733747185152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (367us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788839529.931140:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788839529.931177:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eb107eed80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788839529.931182:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb107eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747185152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788839529.932726:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+20:14544:x1875733729376768:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 88350us (89441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.932755:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000001:00080000:0.0:1788839529.933045:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788839529.940375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.940509:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729376896 00000100:00100000:2.0:1788839529.940518:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729376896 00000100:00100000:2.0:1788839529.940570:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1788839529.940579:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb0310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+7:2358:x1875733729376896:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788839529.940671:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb0310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+7:2358:x1875733729376896:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 94us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.940676:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1788839529.954933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.955014:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729377152 00000100:00100000:0.0:1788839529.955024:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729377152 00000100:00100000:0.0:1788839529.955107:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:0.0:1788839529.955116:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb03108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+13:14544:x1875733729377152:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.955160:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839529.955182:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beec00/0x4b63896d6364135a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb48c expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.955197:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:0.0:1788839529.955201:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839529.955225:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.955235:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.955254:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839529.955488:0:14373:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000875b04a4 reply state 000000002edc257a transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.955496:0:14373:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839529.955579:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb03108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+14:14544:x1875733729377152:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 463us (657us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788839529.955586:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00010000:00010000:2.0:1788839529.966008:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.966024:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.966032:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.966039:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01beee00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839529.966044:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.966092:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.966109:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:2.0:1788839529.966113:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839529.966117:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.966140:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01beee00/0x4b63896d63641368 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839529.967074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.967252:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729377280 00000100:00100000:0.0:1788839529.967262:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729377280 00000100:00100000:0.0:1788839529.967313:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:0.0:1788839529.967333:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+7:14544:x1875733729377280:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.967350:0:15055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839529.967366:0:15055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb49a expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.967393:0:15055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 8 pid: 15055 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.967401:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839529.967405:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839529.967410:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.967444:0:15055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 8 pid: 15055 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.967469:0:15055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 8 pid: 15055 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.967494:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15055:1875733747185280:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839529.967577:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0c652d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839529.972239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.972470:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729377408 00000100:00100000:2.0:1788839529.972488:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729377408 00010000:00010000:2.0:1788839529.972530:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 9 pid: 15055 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839529.972578:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1788839529.972588:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+9:2357:x1875733729377408:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839529.972604:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839529.972626:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 9 pid: 15055 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.972640:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 9 pid: 15055 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.972663:0:14358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839529.972669:0:14358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839529.972675:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 9 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.972686:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 9 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.972723:0:14358:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 9 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839529.972750:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb107ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14358:1875733747185408:192.168.201.9@tcp:105: 00000100:00100000:2.0:1788839529.972830:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788839529.973665:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641361 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb493 expref: 9 pid: 15055 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.973682:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15055:1875733747185280:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839529.973714:0:15055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.973726:0:15055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01beec00, rc 0) 00000100:00100000:0.0:1788839529.973814:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+8:14544:x1875733729377280:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 6491us (6770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.973822:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:3.0:1788839529.977469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.977567:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb107ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14358:1875733747185408:192.168.201.9@tcp:105: 00010000:00010000:2.0:1788839529.977586:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839529.977636:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:2357:x1875733729377408:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 5051us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.977645:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1788839529.978529:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729377536 00000100:00100000:0.0:1788839529.978537:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729377536 00000100:00100000:0.0:1788839529.978609:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:0.0:1788839529.978617:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb33768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:2357:x1875733729377536:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788839529.978782:0:15058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788839529.978786:0:15058:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788839530 00002000:00010000:0.0:1788839529.978789:0:15058:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788839528 00002000:00010000:0.0:1788839529.978806:0:15058:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788839530 -> 1788839530 00002000:00010000:0.0:1788839529.978808:0:15058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788839529.978862:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb33768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+8:2357:x1875733729377536:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 245us (1402us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788839529.978870:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:1.0:1788839529.982497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839529.982557:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729377664 00000100:00100000:0.0:1788839529.982565:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729377664 00000100:00100000:0.0:1788839529.982611:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1788839529.982618:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+8:2357:x1875733729377664:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788839529.982656:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.982673:0:15055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.982681:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839529.982684:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839529.982687:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.982715:0:15055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.982724:0:15055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 8 pid: 15055 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.982751:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15055:1875733747185536:192.168.201.9@tcp:104: 00000100:00100000:0.0:1788839529.982884:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0c652d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839529.985350:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15055:1875733747185536:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839529.985391:0:15055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839529.986993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839529.987271:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729377792 00000100:00100000:3.0:1788839529.987280:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729377792 00010000:00010000:3.0:1788839529.987320:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 9 pid: 15055 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839529.987371:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:3.0:1788839529.987382:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+9:2358:x1875733729377792:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839529.987398:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839529.987423:0:14357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 9 pid: 15055 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.987451:0:14357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 9 pid: 15055 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.987486:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fab158db/0x4b63896d6364136f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb49a expref: 9 pid: 15055 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.987505:0:14357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839529.987510:0:14357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839529.987515:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.987525:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839529.987557:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839529.987615:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+8:2358:x1875733729377792:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 234us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839529.987623:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00010000:00010000:0.0:1788839529.988099:0:15055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988109:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988134:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988142:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988149:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988157:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ea01bef600 already unused, calling callback (ffffffffc1407420) 00010000:00010000:0.0:1788839529.988161:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988175:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988185:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.988190:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083754812/0x4b63896d63641376 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.988233:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+7:2357:x1875733729377664:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 5615us (5744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.988238:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1788839529.991130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.991232:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729378048 00000100:00100000:2.0:1788839529.991242:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729378048 00000100:00100000:2.0:1788839529.991301:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:2.0:1788839529.991312:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+13:14544:x1875733729378048:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788839529.991503:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.991520:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.991532:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.991758:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.991770:0:14659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 14 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.991786:0:14659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.991815:0:14659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 14 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.991829:0:14659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 14 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839529.991844:0:14659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb107ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747185664:192.168.201.9@tcp:104: 00000100:00100000:2.0:1788839529.991944:0:14659:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb36fd7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839529.994791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839529.995032:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729378176 00000100:00100000:2.0:1788839529.995042:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729378176 00010000:00010000:2.0:1788839529.995102:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 15 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839529.995148:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1788839529.995160:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+15:2357:x1875733729378176:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839529.995174:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839529.995181:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 15 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.995193:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 15 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.995215:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:2.0:1788839529.995234:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.995243:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.995251:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839529.995271:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839529.995444:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+15:2357:x1875733729378176:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 286us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839529.995452:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00010000:00010000:0.0:1788839529.995982:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01befe00/0x4b63896d6364134c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb485 expref: 14 pid: 14373 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839529.996001:0:14659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb107ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747185664:192.168.201.9@tcp:104: 00010000:00010000:0.0:1788839529.996023:0:14659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.996045:0:14659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839529.996077:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839529.996257:0:14659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788839529.996410:0:14659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788839529.996454:0:14659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788839529.996539:0:14659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14659:1875733747185792:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788839529.996617:0:14659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839529.996643:0:14659:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb064ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839529.996683:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747185792 00000100:00100000:1.0:1788839529.996689:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747185792 00000100:00100000:1.0:1788839529.996764:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839529.996771:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14659:x1875733747185792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788839529.996833:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14659:x1875733747185792:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839529.996840:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839529.996863:0:14659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14659:1875733747185792:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788839529.997810:0:14659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788839529.997875:0:14659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14659:1875733747185920:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788839529.997928:0:14659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839529.997956:0:14659:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb0c652d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839529.998444:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747185920 00000100:00100000:2.0:1788839529.998452:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747185920 00000100:00100000:2.0:1788839529.998499:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839529.998509:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14659:x1875733747185920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788839529.998676:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14659:x1875733747185920:12345-0@lo:1000:mdt00_003.0 Request processed in 168us (747us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788839529.998684:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839529.998928:0:14659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14659:1875733747185920:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788839529.998964:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.998973:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.998980:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.998996:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839529.999000:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999007:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999022:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:1.0:1788839529.999025:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839529.999030:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999036:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964600/0x4b63896d63641384 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999082:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999089:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999094:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999099:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20a6e600 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839529.999102:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999108:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999126:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb20904100) 00010000:00010000:1.0:1788839529.999128:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839529.999134:0:14659:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb469 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999145:0:14659:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb469 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999153:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb469 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839529.999179:0:14659:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ea01bee800/0x4b63896d636412e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb469 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839529.999190:0:14659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40adc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747186048:192.168.201.9@tcp:105: 00000100:00100000:1.0:1788839529.999255:0:14659:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eb10bb6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839530.002309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839530.002399:0:14659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40adc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14659:1875733747186048:192.168.201.9@tcp:105: 00010000:00010000:0.0:1788839530.002423:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839530.002430:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20a6e600/0x4b63896d636412dc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002509:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839530.002515:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729378304 00000100:00100000:3.0:1788839530.002523:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729378304 00010000:00010000:2.0:1788839530.002523:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002535:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002545:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002568:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002574:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002579:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20965800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839530.002583:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839530.002588:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00010000:00010000:2.0:1788839530.002591:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839530.002598:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+18:14543:x1875733729378304:12345-192.168.201.9@tcp:49:bash.0 00010000:00010000:2.0:1788839530.002602:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb20904100) 00010000:00010000:2.0:1788839530.002605:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839530.002608:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002613:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20965800/0x4b63896d6364138b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002624:0:14659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002629:0:14659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002634:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002638:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:2.0:1788839530.002647:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002653:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002660:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb20904100) 00010000:00010000:2.0:1788839530.002662:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839530.002665:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.002670:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d6364137d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839530.002720:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+18:14543:x1875733729378304:12345-192.168.201.9@tcp:49:bash.0 Request processed in 123us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839530.002737:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00080000:0.0:1788839530.002851:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839530.002918:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5875ff00-b531-42d6-8f43-f0e838002ea7+17:14544:x1875733729378048:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 11608us (11796us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788839530.002927:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000020:00080000:2.0:1788839530.002931:0:14659:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788839530.003963:0:14406:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788839530.004803:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839530.004855:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788839530.004863:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788839530.006142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839530.006216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839530.006289:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729378560 00000100:00100000:0.0:1788839530.006293:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729378688 00000100:00100000:0.0:1788839530.006297:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729378688 00000100:00100000:3.0:1788839530.006298:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729378560 00000100:00100000:3.0:1788839530.006340:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1788839530.006350:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+17:14544:x1875733729378560:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788839530.006350:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1788839530.006357:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+7:14543:x1875733729378688:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1788839530.006369:0:15058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839530.006389:0:15058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641392 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb4a1 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839530.006410:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f866a, atime: 0x6a9f8668, ctime: 0x6a9f866a, blocks: 0x1 00010000:00010000:0.0:1788839530.006427:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1788839530.006443:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839530.006452:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb4a1 expref: 8 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839530.006467:0:15058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f5f2081/0x4b63896d63641392 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb4a1 expref: 8 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839530.006485:0:15058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ea01bef200, rc 0) 00000100:00100000:0.0:1788839530.006536:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+8:14543:x1875733729378688:12345-192.168.201.9@tcp:101:bash.0 Request processed in 180us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839530.006543:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000004:00080000:2.0:1788839530.010692:0:14375:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788839530.010859:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:0.0:1788839530.010985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839530.011076:0:14374:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788839530.011087:0:14374:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00010000:2.0:1788839530.011111:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.011128:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.011140:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.011149:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.011167:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.011173:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.011193:0:14375:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788839530.011294:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+19:14544:x1875733729378560:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 4944us (5077us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788839530.011303:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000020:00080000:2.0:1788839530.011310:0:14375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788839530.011330:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729378944 00000100:00100000:2.0:1788839530.011338:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729378944 00010000:00010000:1.0:1788839530.011460:0:15489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839530.011468:0:15489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839530.011477:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00010000:00010000:1.0:1788839530.011480:0:15489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb20964e00 already unused, calling callback (ffffffffc1407420) 00010000:00010000:1.0:1788839530.011484:0:15489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839530.011486:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+19:14543:x1875733729378944:12345-192.168.201.9@tcp:35:bash.0 00010000:00010000:1.0:1788839530.011496:0:15489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.011508:0:15489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eb10996500) 00010000:00010000:1.0:1788839530.011511:0:15489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788839530.011515:0:15489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.011521:0:15489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964e00/0x4b63896d63641399 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.011532:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839530.011534:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839530.011536:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788839530.011726:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:2.0:1788839530.011794:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+21:14543:x1875733729378944:12345-192.168.201.9@tcp:35:bash.0 Request processed in 308us (814us total) trans 8589934632 rc 0/0 00000100:00100000:2.0:1788839530.011802:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000020:00080000:2.0:1788839530.011806:0:14375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788839530.080913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839530.081027:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729379200 00000100:00100000:3.0:1788839530.081037:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729379200 00000100:00100000:2.0:1788839530.081372:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:2.0:1788839530.081384:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+21:14554:x1875733729379200:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1788839530.081407:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839530.081425:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d636413a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7825089d24dbb4a8 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839530.081508:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788839530.081644:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d636413a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb4a8 expref: 23 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.081661:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eb20904900) 00010000:00010000:2.0:1788839530.081664:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839530.081669:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb20964800/0x4b63896d636413a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0x7825089d24dbb4a8 expref: 23 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839530.081681:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eb20964800, rc 0) 00000100:00100000:2.0:1788839530.081836:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+22:14554:x1875733729379200:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 453us (941us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1788839530.081844:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:0.0:1788839530.084580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1788839530.084673:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729379328 00000100:00100000:1.0:1788839530.084682:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729379328 00000100:00100000:1.0:1788839530.084736:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:1.0:1788839530.084743:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+22:14554:x1875733729379328:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:1.0:1788839530.084804:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.084816:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.084824:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.084836:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.084857:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.084864:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085340:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085351:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085359:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839530.085399:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085412:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085418:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085425:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085430:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9c800 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839530.085435:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085443:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085463:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eb10996400) 00010000:00010000:1.0:1788839530.085466:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839530.085471:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085477:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9c800/0x4b63896d636413ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085490:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085496:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085501:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085506:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9d000 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839530.085509:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085515:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085521:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91eb05a79b00) 00010000:00010000:1.0:1788839530.085524:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839530.085526:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085532:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9d000/0x4b63896d636413b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085556:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085563:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085569:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085574:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eb09c9cc00 already unused, calling callback (ffffffffc1e594f0) 00010000:00010000:1.0:1788839530.085577:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085583:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085591:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eb20904100) 00010000:00010000:1.0:1788839530.085593:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839530.085596:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839530.085601:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eb09c9cc00/0x4b63896d636413bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839530.085665:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+22:14554:x1875733729379328:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 920us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839530.085673:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:1.0:1788839530.087724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1788839530.087935:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729379584 00000100:00100000:2.0:1788839530.087945:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729379584 00000100:00100000:2.0:1788839530.087998:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1788839530.088010:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+22:14554:x1875733729379584:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1788839530.088604:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb40adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5875ff00-b531-42d6-8f43-f0e838002ea7+23:14554:x1875733729379584:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 596us (888us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1788839530.088613:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00010000:00010000:2.0:1788839530.240718:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839531.262012:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839531.342636:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb40adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3311:1875733747186176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.342778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839531.342826:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea02eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747186688:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.342853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839531.342887:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788839531.342893:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea02eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747186304:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.345864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839531.346496:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747186176 00000100:00100000:0.0:1788839531.346506:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747186176 00000100:00100000:0.0:1788839531.346555:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788839531.346566:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb106b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3311:x1875733747186176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839531.346735:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea02eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747186432:0@lo:400:kworker.0 00000100:00100000:0.0:1788839531.347865:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb106b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7e0041a-0f2b-4d5c-901d-ed02d83b952c+19:3311:x1875733747186176:12345-0@lo:400:kworker.0 Request processed in 1296us (5144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839531.347893:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788839531.347951:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea02eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747186560:0@lo:400:kworker.0 00000100:00100000:0.0:1788839531.347985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839531.348132:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747186304 00000100:00100000:0.0:1788839531.348138:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747186304 00000100:00100000:0.0:1788839531.348181:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839531.348203:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea02eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747186304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839531.348246:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea02eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875733747186304:12345-0@lo:400:kworker.0 Request processed in 44us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839531.348252:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839531.348269:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747186688 00000100:00100000:0.0:1788839531.348272:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747186688 00000100:00100000:0.0:1788839531.348295:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747186560 00000100:00100000:0.0:1788839531.348298:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747186560 00000100:00100000:0.0:1788839531.348315:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839531.348321:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea02eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747186688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839531.348355:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea02eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875733747186688:12345-0@lo:400:kworker.0 Request processed in 33us (5500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839531.348435:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839531.348448:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839531.348454:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747186560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839531.348486:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875733747186560:12345-0@lo:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839531.348492:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788839531.348508:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839531.348513:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839531.348546:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea02eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875733747186560:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.357111:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea02eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875733747186304:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.357128:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ea02eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747186816:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.357201:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839531.357237:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb40adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7e0041a-0f2b-4d5c-901d-ed02d83b952c:3311:1875733747186176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.357250:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea02eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875733747186688:0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.357287:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747186816 00000100:00100000:1.0:1788839531.357291:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747186816 00000100:00100000:1.0:1788839531.357495:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839531.357505:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ea02eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747186816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839531.357560:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ea02eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875733747186816:12345-0@lo:400:kworker.0 Request processed in 56us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839531.357566:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788839531.357589:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839531.357610:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea02eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875733747186816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839531.369221:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839531.369279:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747186944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839531.369341:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839531.369531:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747186432 00000100:00100000:2.0:1788839531.369540:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747186432 00000100:00100000:2.0:1788839531.369607:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839531.369617:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb330f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747186432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839531.369670:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb330f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747186432:12345-0@lo:400:kworker.0 Request processed in 55us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839531.369689:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788839531.369877:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839531.369911:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ea02eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747186432:0@lo:400:kworker.0 00000100:00100000:0.0:1788839531.373940:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747186944 00000100:00100000:0.0:1788839531.373955:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747186944 00000100:00100000:0.0:1788839531.374112:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839531.374125:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747186944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839531.374167:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788839531.374282:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875733747186944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839531.374304:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839531.380154:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875733747186944:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788839531.830663:0:16642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788839532.285689:0:15489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839533.310629:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839533.626367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1788839533.626422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1788839533.626651:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729379712 00000100:00100000:3.0:1788839533.626661:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729379712 00002000:00100000:3.0:1788839533.626724:0:15061:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff91eb37575880 x1875733729379712/t0(0) o4->5875ff00-b531-42d6-8f43-f0e838002ea7@192.168.201.9@tcp:679/0 lens 504/0 e 0 to 0 dl 1788839544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788839533.626736:0:15061:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb37575880 with x1875733729379712 ext(0->8) 00002000:00010000:3.0:1788839533.626742:0:15061:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb37575880 00000100:00100000:3.0:1788839533.626769:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1788839533.626781:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+8:2358:x1875733729379712:12345-192.168.201.9@tcp:4:bash.0 00000100:00100000:3.0:1788839533.627354:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5875ff00-b531-42d6-8f43-f0e838002ea7+10:2358:x1875733729379712:12345-192.168.201.9@tcp:4:bash.0 Request processed in 573us (997us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788839533.627364:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00002000:00100000:3.0:1788839533.627372:0:15061:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff91eb37575880 x1875733729379712/t8589934598(0) o4->5875ff00-b531-42d6-8f43-f0e838002ea7@192.168.201.9@tcp:679/0 lens 504/448 e 0 to 0 dl 1788839544 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788839533.627381:0:15061:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eb37575880 with x1875733729379712 ext(0->8) 00002000:00010000:3.0:1788839533.627386:0:15061:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eb37575880 00000100:00080000:2.0:1788839533.627511:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839533.627572:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733729379840 00000100:00100000:1.0:1788839533.627577:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733729379840 00000100:00100000:1.0:1788839533.627617:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:1.0:1788839533.627625:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+10:2358:x1875733729379840:12345-192.168.201.9@tcp:16:kworker.0 00000001:00080000:3.0:1788839533.688743:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1788839533.688761:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788839533.688770:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:1.0:1788839533.693348:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5875ff00-b531-42d6-8f43-f0e838002ea7+6:2358:x1875733729379840:12345-192.168.201.9@tcp:16:kworker.0 Request processed in 65709us (66910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839533.693363:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:0.0:1788839533.890083:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eb37df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747187072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839533.890169:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839533.890245:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875733747187072 00000100:00100000:1.0:1788839533.890255:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875733747187072 00000100:00100000:1.0:1788839533.890337:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788839533.890347:0:14367:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839533.890349:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eb37577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747187072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839533.890376:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788839533.890435:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eb37577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875733747187072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839533.890443:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839533.890471:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788839533.890478:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eb107eed80, transno 8589934595 00000004:00080000:3.0:1788839533.890503:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788839533.890542:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eb37df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875733747187072:0@lo:13:osp-pre-0-0.0 Debug log: 30071 lines, 30071 kept, 0 dropped, 0 bad.